/bitsandbytes/functional.py", line 1017, in dequantize_4bit absmax = quant_state.absmax AttributeError: 'list' object has no attribute 'absmax'
原来是bitsandbytes的版本不对,pip install "bitsandbytes<0.41.2" 解决
· Sign up or log in to comment