Could you please release the GGUF version of this model too?
Hi, I've uploaded the GGUF model (Q8 and Q4_K_M) here. Quantizing llm for the first time, let me know if it works for you.
Thank you so much. I am downloading them now.
· Sign up or log in to comment