AWQ Quantization

#2
by maher13 - opened

Hello Mohamed,
Thanks for your effort
Would you mind sharing the method to convert the checkpoint into awq format?
Many Thanks

I wrote the quantization script i used here

MohamedRashad changed discussion status to closed

Sign up or log in to comment