Repetition issues
Sadly it seems this model has a bad habit of repeating itself, it happened very quickly during my RPs with it. It also seems not as smart as NeMo but maybe I need to test it some more... Apart from the repetition issue, it's not bad.
The quality obviously depends on the GGUF you have chosen, with the base model I did not encounter any repetition problems, have you tried to adjust the repetition_penalty? or use another GGUF? what can I do on my side to spot this problem?
I used a Q5KM from another person on here, and no repetition penalty or anything else as I don't really require that usually with bigger models... I'm testing again now to try and reproduce it.
It also seems to really like NOT following instructions 😅
Oh sorry for that, I never use GGUF I didn't test anything before uploading.. I can understand that you don't like the model there is no problem don't force yourself to use it if it doesn't seem to fit!
It's a promising model, I just wanted to help find what's wrong 🙁
Two other people on reddit talked about this problem, I wonder if it comes from a quants or if it's all of them that are bugged.. have you had any problems with the bartowski or mradermacher quants?
Yeah I started with mrademacher then yours and had the same issues