Feedback

#6
by BigBeavis - opened

First, was a bit overwhelming to set it up to do its job properly locally in sillytavern, then i realized i'm wasting my time since it's available for free on the website O_O.

Fed it a ~250 token descriptions, and good pretty nice results. Not really anything perfect, but easy to take it from there with a bit of editing, arranging from parts of different generations. It's nice how it actually can invent some nuanced details, so it's not just blowing up your initial prompt, but actually building something more upon it.

So, i found that it's pretty good for generating drafts for descriptions and tags. For "first messages" though... And especially "dialogue examples"... Not so much. Perhaps understandably so... Either way, i feel like those are the things that must be written by hand anyway, so it's not really an issue.

Despite the claim that the model will process User and Char into {{user}} and {{char}} automatically, the reality is that it's unreliable, most often i see the word "user's" not converted into {{user}}'s. Easy to clean up in notepad with ctrl+f, but makes me wonder if it would've been better to just not do the whole thing with "using User and Char instead of {{user}} and {{char}}" altogether.

Hey thanks for such detailed feedback, I really appreciate it!
First messages and dialogue examples are being worked on - don't you worry :) In fact, you can see if it's better in the current CharGen v3 beta model on the website! Head to settings and select the current beta (it changes every couple of days, and sometimes there are multiple deployed), and see if it handles dialogue examples any differently.

Regarding the {{user}} and {{char}} placeholders - the decision to omit those came from Mistral 7b struggling to correlate those to actual names of participants and often confusing the two. Modern and/or bigger models don't seem to have this problem anymore, yet the dataset is currently formatted without those placeholders, so it will stay this way for the time being. For the issue of the website failing to replace some cases of User with {{user}} - I'll add some tests on my end and hopefully will fix soon - thanks for pointing it out!

If you decide to try out CharGen v3 beta - I would appreciate your feedback as well. Either in this thread or through the website's Feedback button is fine :)
Thanks again!

Didn't realize there was a v3 beta, i'll try it out!

Sign up or log in to comment