TencentARC

/

LLaMA-Pro-8B-Instruct

like 62

Follow

ARC Lab, Tencent PCG 330

I tested 4 formats as part of my evaluation, this was the only one that worked:

<s>[INST] <<SYS>>
Provide answers in Python.  The code must start with ```python and end with ```.
<</SYS>>

<prompt-here>[/INST]

Tweak system prompt as appropriate.

Following up on this, it doesn't look like the chat template is defined correctly from commit 9850c8afce19a69d8fc4a1603a82441157514016. It only accounts for the user and assistant roles (i.e. doesn't include the system role). Consequently, any system prompts being provided are currently being ignored.