gguf models and quantizations?
#1
by
AutomaticHourglass
- opened
Is there a possibility to publish quantized models(especially q8) and gguf models?
You don’t need to do hat, I will publish the gguf models later this day, but in you still want to, go ahead.
Please do, I’ll continue following you.
Hey, I'm starting to upload the quants.
Goekdeniz-Guelmez
changed discussion status to
closed