Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.2-3B-Instruct-GGUF
like
7
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
425b2d5
Llama-3.2-3B-Instruct-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
3832590de20f79829a2efecac4a3e9e465ac6a752350e80e6436ee9dece841f5
425b2d5
verified
about 2 months ago
.gitattributes
2.01 kB
3832590de20f79829a2efecac4a3e9e465ac6a752350e80e6436ee9dece841f5
about 2 months ago
Llama-3.2-3B-Instruct-GGUF_imatrix.dat
2.99 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
about 2 months ago
Llama-3.2-3B-Instruct.IQ1_M.gguf
924 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
about 2 months ago
Llama-3.2-3B-Instruct.IQ1_S.gguf
868 MB
LFS
cb5dfe77bc292db3e6c0c82aa49e147abffe4d482eca95e0660eaa1673cb49ff
about 2 months ago
Llama-3.2-3B-Instruct.IQ2_XS.gguf
1.1 GB
LFS
98b19ed60d36d7b7f1400fb11b73b20d056e0036b40c4e3fbc266dba2ad5d956
about 2 months ago
Llama-3.2-3B-Instruct.IQ3_XS.gguf
1.48 GB
LFS
b4b5db12a7f20c40678ca0116316cb9ceaac3ea0b3a50fa8af095eb5bbf8b7a9
about 2 months ago
Llama-3.2-3B-Instruct.IQ4_XS.gguf
1.83 GB
LFS
a58938953b780dd0e7a1745b23d215069ea6c006b1fe905878824299c952ab00
about 2 months ago
Llama-3.2-3B-Instruct.Q2_K.gguf
1.36 GB
LFS
3832590de20f79829a2efecac4a3e9e465ac6a752350e80e6436ee9dece841f5
about 2 months ago
