Hugging Face's logo

neuralmagic
/
Llama-2-7b-chat-quantized.w4a16

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Llama-2-7b-chat-quantized.w4a16 / quantize_config.json

Commit History

Upload quantize_config.json with huggingface_hub
cc2c52a
verified

abhinavnmagic commited on