Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
en
dataset:HuggingFaceH4/ultrachat_200k
dataset:HuggingFaceH4/ultrafeedback_binarized
arxiv:2305.18290
arxiv:2310.16944
Eval Results
Inference Endpoints
has_space
text-generation-inference
conversational
MaziyarPanahi
commited on
Commit
•
b183f33
1
Parent(s):
7b611fb
Rename file.
Browse files
.gitattributes
CHANGED
@@ -45,3 +45,4 @@ zephyr-7b-beta.Q6_K.ggufm filter=lfs diff=lfs merge=lfs -text
|
|
45 |
zephyr-7b-beta.Q8_0.ggufm filter=lfs diff=lfs merge=lfs -text
|
46 |
zephyr-7b-beta.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
47 |
zephyr-7b-beta.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
45 |
zephyr-7b-beta.Q8_0.ggufm filter=lfs diff=lfs merge=lfs -text
|
46 |
zephyr-7b-beta.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
47 |
zephyr-7b-beta.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
48 |
+
zephyr-7b-beta.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
zephyr-7b-beta.Q3_K_M.ggufm → zephyr-7b-beta.Q3_K_M.gguf
RENAMED
File without changes
|