Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-Chat-Summary-3.2-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Llama-Chat-Summary-3.2-3B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
ef9254ebffd5150552d1e55a6cc78e6ae43fe6a6424445d69bcb3cee5361cfca
8b90018
verified
5 days ago
.gitattributes
Safe
1.96 kB
ef9254ebffd5150552d1e55a6cc78e6ae43fe6a6424445d69bcb3cee5361cfca
5 days ago
Llama-Chat-Summary-3.2-3B-GGUF_imatrix.dat
2.99 MB
LFS
ef9254ebffd5150552d1e55a6cc78e6ae43fe6a6424445d69bcb3cee5361cfca
5 days ago
Llama-Chat-Summary-3.2-3B.Q5_K_M.gguf
Safe
2.32 GB
LFS
7c3ebc0629e7c3d83ebcc8d91c9f6f32a6a8ea8ee073d5eed1df89fc78e42564
5 days ago
Llama-Chat-Summary-3.2-3B.Q5_K_S.gguf
Safe
2.27 GB
LFS
76245cb24ebfa3d3cf952ab104b280e83d1c6cf79a2d3d0a24016a44866b3506
5 days ago
Llama-Chat-Summary-3.2-3B.Q6_K.gguf
Safe
2.64 GB
LFS
0fd5e8b43f96e5b0f7a897ea9fa6a20d024a203dc0c83ad644be93fd7629549e
5 days ago
Llama-Chat-Summary-3.2-3B.Q8_0.gguf
Safe
3.42 GB
LFS
4bc3a74595f8f3ec86e265fa84e95cf532e51a077fa4b2fa3c97e4e435e69ab8
5 days ago
Llama-Chat-Summary-3.2-3B.fp16.gguf
Safe
6.43 GB
LFS
fdf251ea0dd280b4da26a87b77d6fe7c5729050cdfdf7733a201f14810e896cb
5 days ago
README.md
Safe
3.05 kB
ef9254ebffd5150552d1e55a6cc78e6ae43fe6a6424445d69bcb3cee5361cfca
5 days ago
