The modelfile I wrote caused Ollama to fail to generate the think section of the r1 model

#11
by caimj - opened

The modelfile I used is as follows. Could you please help me check where the problem is? Thank you very much.

FROM ./ds.guff
#TEMPLATE "[INST] {{ .Prompt }} [/INST]"
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>

{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>

{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>

{{ .Response }}<|eot_id|>"""
PARAMETER num_keep 24
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
SYSTEM A chat between a curious user and an artificial intelligence assistant.The assistant gives helpful, detailed, and polite answers to the user's questions.
PARAMETER repeat_penalty 1.15
PARAMETER temperature 0.6
PARAMETER top_p 1

Sign up or log in to comment