fbaldassarri
/

meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym

Text Generation

intel-autoround

text-generation-inference

8-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym / quantize_config.json

Commit History

Initial Upload

5368b8d
verified

fbaldassarri commited on 12 days ago