Nice!
The Q6_K works great!
It's pretty great at following character cards, as long as there's enough info to work with.
It's got this odd little quirk where its very good at telling stories and keeping a narrative going, but if your characters in the story or the RP aren't fleshed out enough, they may act a little screwy or out of character. Not a dealbreaker or anything, it's just a little odd thing I noticed.
It's a very strong and fun model to play with :D
Yeah I have noticed that, And I have been able to make the model better through settings and other things in silly tavern (The front end I use), but I am trying to see if I can fix the problems through a new model, if I cannot I will just release them.
Wow I seriously took a month... Anyways just updated the main model page, if you use Silly tavern it will be easiest, since I use it as a front end. but there should be enough there to make the model behave better. I wish I could have gotten a new model done, but Runpod is being silly and AutoGPTQ Refuses to work, which is what I personally use on my computer, since EXLlamaV2 runs very well on 13b models.