How to use "imatrix"?
#1
by
bidedadi12345
- opened
How to use this "Huihui-gpt-oss-20b-BF16-abliterated-v2.imatrix.gguf" file and its corresponding model in LM Studio?
You don't. You only need it when creating your own weighted/imatrix quants using llama-quantize present inside llama.cpp. All quants in this repository are already weighted/imatrix quants so just download and use them instead.
Lmstudio Load Huihui-gpt-oss-20b-BF16-abliterated-v2.i1-MXFP4_MOE.gguf, Very good XD