gobean
/

Mixtral-8x7B-Instruct-v0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

gobean commited on Apr 18

Commit

914136a

•

1 Parent(s): 3cd8e70

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,7 +1,7 @@
 ---
 license: apache-2.0
 ---
-Update: Someone requested q4_0, q5_0, and q6_k. Added, and q5_0 is my new favorite for this any any Mixtral derivative. Try it. Something about the 'k' process ever so slightly alters mixtrals. Compare if you don't believe me.
 These are the quantized GGUF files for [Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1).

 ---
 license: apache-2.0
 ---
+Update: Someone requested q4_0, q5_0, and q6_k. Added, and q5_0 is my new favorite for this and any Mixtral derivative. Try it. Something about the 'k' process ever so slightly alters mixtrals. Compare if you don't believe me.
 These are the quantized GGUF files for [Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1).