Hugging Face's logo

Nioooor
/
q4_k_m_llama3

Question Answering
GGUF
English
llama
Inference Endpoints
Model card Files Community
Edit model card
README.md exists but content is empty. Use the Edit model card button to edit it.
Downloads last month
5
GGUF
Model size
8.03B params
Architecture
llama

4-bit

Inference Examples
Question Answering
Unable to determine this model's library. Check the docs .

Model tree for Nioooor/q4_k_m_llama3

Base model

meta-llama/Meta-Llama-3-8B
Quantized
unsloth/llama-3-8b-bnb-4bit
Quantized
(669)
this model

Dataset used to train Nioooor/q4_k_m_llama3