Wrong chat template?
I noticed the chat template for the new openchat-3.5-0106-gemma is not the one you list in the main page:
GPT4 Correct User: HelloGPT4 Correct Assistant: HiGPT4 Correct User: How are you today?GPT4 Correct Assistant:
Because if you check the "chat_template" key at:
https://huggingface.co/openchat/openchat-3.5-0106-gemma/blob/main/tokenizer_config.json
It's missing the "GPT4 Correct ..." prefixes.
So, which template is the correct? The one with "GPT4 Correct ..." or the one listed in the tokenizer_config?
(Thanks - the OpenChat models are great!)
I just updated "chat_template" in tokenizer_config.json with the following code: {{ bos_token }}{% for message in messages %}{{ 'GPT4 Correct ' + message['role'].title() + ': ' + message['content'] + '<end_of_turn>'}}{% endfor %}{% if add_generation_prompt %}{{ 'GPT4 Correct Assistant:' }}{% endif %}
. As a result, the chat template on the main page now matches.