Usage of --apply_chat_template in lm_eval benchmarks

#1
by VlSav - opened

Hello!
Could you please clary why in several lm_eval benchmark " --apply_chat_template" parameter was used, but in others it was not utilized?
(according to command lines of lm_eval execution in readme.md).

Sign up or log in to comment