Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
TinyMistral-248M-SFT-v4-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
dataset:OpenAssistant/oasst_top1_2023-08-25
has_space
text-generation-inference
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
664df2e
TinyMistral-248M-SFT-v4-GGUF
1 contributor
History:
2 commits
MaziyarPanahi
Upload folder using huggingface_hub
664df2e
verified
10 months ago
.gitattributes
2.24 kB
Upload folder using huggingface_hub
10 months ago
README.md
11.1 kB
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q2_K.ggufm
105 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q3_K_L.ggufm
137 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q3_K_M.ggufm
129 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q3_K_S.ggufm
120 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q4_K_M.ggufm
156 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q4_K_S.ggufm
149 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q5_K_M.ggufm
179 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q5_K_S.ggufm
176 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q6_K.ggufm
204 MB
LFS
Upload folder using huggingface_hub
10 months ago
TinyMistral-248M-SFT-v4.Q8_0.ggufm
264 MB
LFS
Upload folder using huggingface_hub
10 months ago
