Hugging Face's logo

JayhC
/
ChaoticSoliloquy-4x8B-6bpw-h6-exl2

Text Generation
Transformers
Safetensors
English
mixtral
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
6-bit
exl2
Model card Files Community
1
JayhC commited on
Commit
a8f6811
•
1 Parent(s): 6d498c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -5,6 +5,15 @@ language:
5
  tags:
6
  - moe
7
  ---
 
 
 
 
 
 
 
 
 
8
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/jgyhmI451GRXri5hEj3lh.png)
9
  (Maybe i'll change the waifu picture later)
10
 
 
5
  tags:
6
  - moe
7
  ---
8
+
9
+ <br/><br/>
10
+ 6bpw/h6 exl2 quantization of [xxx777xxxASD/ChaoticSoliloquy-4x8B](https://huggingface.co/xxx777xxxASD/ChaoticSoliloquy-4x8B) using default exllamav2 calibration dataset.
11
+
12
+ ---
13
+
14
+ **ORIGINAL CARD:**
15
+
16
+
17
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/jgyhmI451GRXri5hEj3lh.png)
18
  (Maybe i'll change the waifu picture later)
19