NameError: name 'awq_ext' is not defined

#29
by abhijeet06793 - opened

Getting - NameError: name 'awq_ext' is not defined error while running below code - model = AutoModelForVision2Seq.from_pretrained(MODEL_ID, quantization_config=quantization_config, device_map=DEVICE)

Can someone please explain how to fix this ?

Attaching screenshot as well -
image.png

Hi @abhijeet06793
this sounds like an autoawq installation issue.
can you double check it is properly installed for you?
parsing https://github.com/casper-hansen/AutoAWQ might be helpful

closing this, feel free to re-open if you still have issues!

VictorSanh changed discussion status to closed

Sign up or log in to comment