Hugging Face's logo

Kalei
/
Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation
Transformers
Safetensors
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom
  • 7 contributors
 History: 21 commits
Kalei's picture
Kalei
Rename rope_type to type for transformers
0a1f36e verified