GGUF version?
#12
by
johnnnna
- opened
Did anyone publish the quantized gguf version of this model?
You mean like here?
https://huggingface.co/miqudev/miqu-1-70b/tree/main
Yeah sorry I didn't check. It's the first time I didn't have to wait for thebloke because we already have the gguf q4-q5 files. Will try them asap
johnnnna
changed discussion status to
closed