Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
en
dataset:HuggingFaceH4/ultrachat_200k
dataset:HuggingFaceH4/ultrafeedback_binarized
arxiv:2305.18290
arxiv:2310.16944
Eval Results
Inference Endpoints
has_space
text-generation-inference
conversational
Rename file.
Browse files
.gitattributes
CHANGED
|
@@ -52,3 +52,4 @@ zephyr-7b-beta.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 52 |
zephyr-7b-beta.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
zephyr-7b-beta.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
zephyr-7b-beta.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 52 |
zephyr-7b-beta.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
zephyr-7b-beta.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
zephyr-7b-beta.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
+
zephyr-7b-beta.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
zephyr-7b-beta.Q8_0.ggufm → zephyr-7b-beta.Q8_0.gguf
RENAMED
|
File without changes
|