GGUF please! 🙏
#1
by
AlexBefest
- opened
I was delighted with Anubis and Negative. I would really like to test this model. Are there any plans to do GGUFs for it?
Hiya. It's currently queued on mradermacher's GGUF queue list. Might be ready in 1-2 days. I don't have enough RAM atm to personally quantize it so I'm still waiting. I enjoyed Anubis and Negative as well so I hope that this merge will work for both of us. Might re-merge again if it doesn't work well.
This comment has been hidden
I was delighted with Anubis and Negative. I would really like to test this model. Are there any plans to do GGUFs for it?
https://huggingface.co/bartowski/Negative-Anubis-70B-v1-GGUF