Garbage output
#1
by
awni
- opened
I'm not able to get decent outputs from this model using mlx-lm.
python -m mlx_lm.generate --model mlx-community/Mistral7B-Inst-v0.2-4bit-mlx-distilabel-capybara-dpo-7k --prompt "What wights more 1kg of feathers or 0.5kg of steel?"
Gives:
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
==========
Is this model working under any other circumstances? If so could you point to the code that can run it?
Yeah there is some issue with training happened on older versions of MLX, I am going to clean up this and upload again
Had the same issue. Thank you though!