Wrong chat template?

#3
by jordio - opened

I noticed the chat template for the new openchat-3.5-0106-gemma is not the one you list in the main page:

GPT4 Correct User: HelloGPT4 Correct Assistant: HiGPT4 Correct User: How are you today?GPT4 Correct Assistant:

Because if you check the "chat_template" key at:
https://huggingface.co/openchat/openchat-3.5-0106-gemma/blob/main/tokenizer_config.json

It's missing the "GPT4 Correct ..." prefixes.

So, which template is the correct? The one with "GPT4 Correct ..." or the one listed in the tokenizer_config?

(Thanks - the OpenChat models are great!)

I just updated "chat_template" in tokenizer_config.json with the following code: {{ bos_token }}{% for message in messages %}{{ 'GPT4 Correct ' + message['role'].title() + ': ' + message['content'] + '<end_of_turn>'}}{% endfor %}{% if add_generation_prompt %}{{ 'GPT4 Correct Assistant:' }}{% endif %}. As a result, the chat template on the main page now matches.

Sign up or log in to comment