Hugging Face's logo

unsloth
/
Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation
Transformers
Safetensors
English
llama
nvidia
llama3.1
unsloth
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
7

to gguf

#2
by sdyy - opened
Discussion
sdyy

how to convert unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit
to gguf?

shimmyshimmer
 Unsloth AI org

how to convert unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit
to gguf?

we already uploaded the GGUF here: https://huggingface.co/unsloth/Llama-3.1-Nemotron-70B-Instruct-GGUF

Sign up or log in to comment