Hugging Face's logo

Maximofn
/
Llama-3-8B-Instruct-GPTQ-3bits

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
3-bit
gptq
Model card Files Community
Llama-3-8B-Instruct-GPTQ-3bits / model.safetensors

Commit History

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False
422fd94
verified

Maximofn commited on