Instruction template
#1
by
LittenBuzz
- opened
Hi
Thanks for you quantization of this model.
Do you have any idea what could the Instruction template for this model be?
to be specific, I run it on oobabooga webui, and it provides a long list of various instruction templates to choose; like llamav2 or llamav3 and ....
it's a custom format
https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B/blob/main/tokenizer_config.json#L34
https://j2live.ttl255.com/
system-message-here<｜User｜>user-message-here<｜Assistant｜>assistant-message-here<｜end▁of▁sentence｜>
lucyknada
changed discussion status to
closed
note the | isnt a pipe, it's a chinese character and so is _, so copy paste it, don't assume