OPEA
/

Qwen2.5-7B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-int4-sym-inc / generation_config.json

Commit History

update to autogptq full sym

2b3d2ef

sys-lpot-val commited on Nov 29, 2024