Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-Chat-Summary-3.2-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
68bb93a
Llama-Chat-Summary-3.2-3B-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
fdf251ea0dd280b4da26a87b77d6fe7c5729050cdfdf7733a201f14810e896cb
68bb93a
verified
5 days ago
.gitattributes
1.88 kB
fdf251ea0dd280b4da26a87b77d6fe7c5729050cdfdf7733a201f14810e896cb
5 days ago
Llama-Chat-Summary-3.2-3B.Q5_K_M.gguf
2.32 GB
LFS
7c3ebc0629e7c3d83ebcc8d91c9f6f32a6a8ea8ee073d5eed1df89fc78e42564
5 days ago
Llama-Chat-Summary-3.2-3B.Q5_K_S.gguf
2.27 GB
LFS
76245cb24ebfa3d3cf952ab104b280e83d1c6cf79a2d3d0a24016a44866b3506
5 days ago
Llama-Chat-Summary-3.2-3B.Q6_K.gguf
2.64 GB
LFS
0fd5e8b43f96e5b0f7a897ea9fa6a20d024a203dc0c83ad644be93fd7629549e
5 days ago
Llama-Chat-Summary-3.2-3B.Q8_0.gguf
3.42 GB
LFS
4bc3a74595f8f3ec86e265fa84e95cf532e51a077fa4b2fa3c97e4e435e69ab8
5 days ago
Llama-Chat-Summary-3.2-3B.fp16.gguf
6.43 GB
LFS
fdf251ea0dd280b4da26a87b77d6fe7c5729050cdfdf7733a201f14810e896cb
5 days ago