Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int4
vllm
chat
neuralmagic
llmcompressor
conversational
4-bit precision
gptq
compressed-tensors
text-generation-inference
4-bit precision
Model card Files
xet
Community
4
Meta-Llama-3.1-8B-Instruct-quantized.w4a16
  • 5 contributors
 History: 24 commits
robgreenberg3's picture
robgreenberg3
Update README.md
5fea09e verified