What's the prompt template for this?

#3
by lucasjin - opened

It looks like generationg model not chat model.

The readme say the template is TBC (I assume that means to be confirmed): https://huggingface.co/TheBloke/CodeLlama-13B-Instruct-GPTQ#prompt-template-tbc

However, @tonymacx86PRO provided a template that is worth trying here: https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF/discussions/1

Hello, this template I made from analyzing the generation script from official codellama repository! Link: https://github.com/facebookresearch/codellama/blob/main/llama/generation.py

thanks, however, I found the result still not correct with format.

Sign up or log in to comment