Hugging Face's logo

LoftQ
/
CodeLlama-70b-hf-4bit-64rank

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

No model card

Downloads last month
16
Safetensors
Model size
35.8B params
Tensor type
F32
·
BF16
·
U8
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Collection including LoftQ/CodeLlama-70b-hf-4bit-64rank