Can't generate text.
#1
by
autobots
- opened
Your model looks very promising and is the right size for a 24gb card but it errors out on me when I try to use it.
I'm trying it on https://github.com/oobabooga/text-generation-webui and kobold
I can load the model but then get this when generating: ValueError: It's impossible to use encoder_no_repeat_ngram_size with decoder-only architecture