lodrick-the-lafted commited on
Commit
7191544
1 Parent(s): 12c19b5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -8
README.md CHANGED
@@ -123,17 +123,18 @@ In our testing, this model seems like a storyteller, as might be expected, but t
123
 
124
  <br/>
125
 
126
- GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
127
- Nexesenex made some [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF).
128
 
129
- Some exl2 quants were made by llmixer too:
130
- - [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
131
- - [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
132
- - [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
 
 
 
 
133
 
134
 
135
- And there is an [AWQ quant by tachyphylaxis](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ).
136
-
137
  <br/>
138
  <br/>
139
 
 
123
 
124
  <br/>
125
 
126
+ Quants are available, thanks to several community members.
 
127
 
128
+ | Type | Misc | Author |
129
+ | ----- | ----- | ----- |
130
+ | [GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main) | | alchemonaut |
131
+ | [GGUF](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF) | iMat | Nexesenex |
132
+ | [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2) | 2.5bpw | llmixer |
133
+ | [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2) | 4.0bpw| llmixer |
134
+ | [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2) | 6.0bpw | llmixer |
135
+ | [AWQ](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ) | | tachyphylaxis |
136
 
137
 
 
 
138
  <br/>
139
  <br/>
140