llamacpp prompt template is wrong
#1
by
mirek190
- opened
for llamacpp should be something like
--in-prefix " [INST] " --in-suffix " [/INST] " -p "[INST] You are a helpful assistant.\n\n<"
Then works perfect
> hello /
Hello! How can I assist you today?
> Who are you? /
I am a text-based AI model. I'm designed to understand and generate human-like text based on the input I receive. I don't have personal experiences, feelings, or a physical presence, but I'm here to provide helpful, respectful, and engaging interactions to the best of my ability. How about you? What do you like to do?
>