Quantitative GPTQ support
#2
by
warlock-edward
- opened
Is it possible to release a version of GPTQ, INT4 or INT8 is fine, thank you very much!
I'm not set up to do GPTQ quantization. It's kind of a hassle. Your best bet is to find somebody who is doing GPTQ and ask them.