Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
grapevine-AI
/
Llama-3.2-3B-Instruct-GGUF
like
1
GGUF
Inference Endpoints
conversational
License:
llama3.2
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Llama-3.2-3B-Instruct-GGUF
1 contributor
History:
3 commits
grapevine-AI
Upload 9 files
e89d070
verified
3 months ago
.gitattributes
Safe
1.98 kB
Upload 9 files
3 months ago
LICENSE.txt
Safe
7.82 kB
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-BF16.gguf
6.43 GB
LFS
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-IQ4_XS.gguf
Safe
1.83 GB
LFS
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-Q4_K_M.gguf
Safe
2.02 GB
LFS
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-Q5_K_M.gguf
2.32 GB
LFS
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-Q6_K.gguf
2.64 GB
LFS
Upload 9 files
3 months ago
Llama-3.2-3B-Instruct-Q8_0.gguf
3.42 GB
LFS
Upload 9 files
3 months ago
README.md
Safe
1.22 kB
Update README.md
3 months ago
USE_POLICY.md
Safe
6.07 kB
Upload 9 files
3 months ago
imatrix.dat
2.99 MB
LFS
Upload 9 files
3 months ago