exl2 quant (measurement.json in main branch)
check revisions for quants
Last Updated: 1/9/2025
I see a lot of folks looking into this model now so I want to make sure folks understand, this is a branch where I upload random test runs. Its publically available but I make no guarantees the model you download will function. I'm doing some wacky stuff. Working on getting a v0.1 out so folks can have something more "stable" to mess with.
A public repo where I'll put my latest KTO results for people to mess around with. Resulting models will be chatML. Obviously experimental and not release ready, but feel free to mess around with whatever is here.
The goal of this model is to make something that feels different from other models out there. It has seen very very little synthetic data and without RL is unusable. I think with some patience, you can enjoy a conversation with this model. I've used the "Simple-1" preset and that seems to work well enough, feel free to experiment.
Temp: 1.0 TopK: 40 TopP: 0.9 RepPen: 1.15
Formatting Settings for Silly Tavern. It should end up as ChatML with username/character names.
- Downloads last month
- 6