Solar 10.7
This model is pretty promising on it's own as a RP model. Nothing I've seen in finetunes really have great prose tho yet. But it does seem to grok the story context often better than a 13b. Like seems like an amazing base at 10.7b for RP. What's more I can run it comfortably on my laptop grade GPU. I hope more people do training with this model!
Also I wonder if you could hybridize it with toppy, without increasing the size? Like maybe 32 of the bottom layers of solar instruct, and 16 of the topmost layers of Toppy? It might work because it has mistral layers mixed in there? Or noromaid as I guess solar is llama-2 and thus incompatible. Lol, I'm probably just too keen to see what this can do when given real training :P
I'm working on a Solar Maid 0.2 with last Noromaid.
Also, SOLAR is Mistral, even if their config say otherwise.
Just remember us GPU poors 🤣 Keep up the good work!
I'm going to have to put this up on the cloud cause my gpu sucks. I love the models you make. just you and the bloke are my 1st go-to people for models. I'm never disappointed