exllama version?
#1
by
Nexesenex
- opened
Hey!
Which version of exllama do you use to quantize? Since 0.0.11, quants have been improved.
I get the latest version of the repo at the time i quant a new model, so the FlatOrcamaid quants are made with 0.0.11 plus whatever other changes had been made at that time.
Note that this specific model is an MLX, not a exllama
Oh, my bad, I'm used to check your exl2 quants and didn't pay attention!
Nevertheless, thank you for the information!