It writes nonsense words in llamacpp and koboldcpp.

#1
by Nightcall - opened

It writes nonsense words in koboldcpp.

Command:
koboldcpp.exe models/dareposte-WizardLM-30b-V1.0-ggmlv3-q4_K_M.bin --smartcontext --useclblast 0 0 --stream

There was a problem with the delta merge and an update was pushed yesterday that fixed it, can you confirm the download time of the model you're using?

Update was pushed 6/14 early afternoon eastern time.

The updated merge appears to have fixed the issue in both kobold and llama

image.png

dareposte changed discussion status to closed

Sign up or log in to comment