Update for new GGUF method?

#1
by JoggyMuffin - opened

https://www.reddit.com/r/LocalLLaMA/comments/1993iro/ggufs_quants_can_punch_above_their_weights_now/

Given how big and cumbersome this model is to run, it would be great if it could get requantized for the new GGUF method. Especially for the XS and XXS sizes.

Sign up or log in to comment