Official quants?

#2
by joshuaturner - opened

I'd love to see the tooling in the repo for "official" quants to be released. My preferred flavour is GGUF, purely for convenience.

IBM Granite org

I'm running this model with gguf through ollama now. Thought I should point this out.

IBM Granite org

yea ollama is working

mayank-mishra changed discussion status to closed

Sign up or log in to comment