Chat Template problem

#1
by djuna - opened

It might be good to use a non-standard chat template that has similar purpose. Instead using words like instructions and response(alpaca), maybe you could use Original and corrected, or something like that.

That's actually an interesting idea; I'll have to try that!

Edit: Version 2 is training right now; it'll probably be done in 40 mins or so :)

Update: It's working now! Even if you ask it a question it won't reply like a regular LLM:

https://huggingface.co/collections/qingy2024/grmr-v2-6759d4172e557af98a2feabc

qingy2024 changed discussion status to closed

Sign up or log in to comment