Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bobofrut
/
Llama3-ChatQA-2-8B-GGUF
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
Edit model card
README.md exists but content is empty. Use the
Edit model card
button to edit it.
Downloads last month
232
GGUF
Model size
8.03B params
Architecture
llama
2-bit
Q2_K
3-bit
Q3_K_S
Q3_K_M
Q3_K_L
4-bit
Q4_K_S
Q4_0
Q4_1
Q4_K_M
5-bit
Q5_K_S
Q5_0
Q5_1
Q5_K_M
6-bit
Q6_K
8-bit
Q8_0
View +2 files
Inference API
Unable to determine this model's library. Check the
docs
.
Model tree for
bobofrut/Llama3-ChatQA-2-8B-GGUF
Base model
nvidia/Llama3-ChatQA-2-8B
Quantized
(
2
)
this model