Odd punctuation formatting
#5
by
Shifusen
- opened
Is anyone else experiencing the model generating spaces after apostrophes after about 4096 tokens in context? This might be a me issue, maybe my prompt or parameter settings, but it appears to occur with both quantized and unquantized models I've tried. Regardless this is the best model I've seen for this particular purpose.
I looked into the training data and couldn't find a reasonable explanation why the model might be doing this - Regardless, your issue will be noted and taken into consideration for any future releases. (Something to keep an eye on, so to speak)
Thank you for reporting this!
Gryphe
changed discussion status to
closed