BaseQuantizeConfig.__init__() got an unexpected keyword argument 'static_groups'
#1
by
StefanStroescu
- opened
Hello, first thing, thanks for your work.
Second, I receive an error when loading the model: BaseQuantizeConfig.init() got an unexpected keyword argument 'static_groups' at line:
AutoGPTQForCausalLM.from_quantized(
model_name,
use_safetensors=True,
trust_remote_code=False,
use_triton=False,
quantize_config=None,
device_map="auto"
)
Any suggestions how this can be solved?
Regards,
Damn it, I forgot that I updated to AutoGPTQ 0.4.0 to test. There's a new keyword in quantize_config.json in 0.4.0. I have just edited this quantize_config to remove it, so re-download quantize_config.json and try again.
I'll go back to AutoGPTQ 0.3.2 for now until more people have AutoGPTQ 0.4.0