lodrick-the-lafted
commited on
Commit
•
7191544
1
Parent(s):
12c19b5
Update README.md
Browse files
README.md
CHANGED
@@ -123,17 +123,18 @@ In our testing, this model seems like a storyteller, as might be expected, but t
|
|
123 |
|
124 |
<br/>
|
125 |
|
126 |
-
|
127 |
-
Nexesenex made some [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF).
|
128 |
|
129 |
-
|
130 |
-
|
131 |
-
|
132 |
-
|
|
|
|
|
|
|
|
|
133 |
|
134 |
|
135 |
-
And there is an [AWQ quant by tachyphylaxis](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ).
|
136 |
-
|
137 |
<br/>
|
138 |
<br/>
|
139 |
|
|
|
123 |
|
124 |
<br/>
|
125 |
|
126 |
+
Quants are available, thanks to several community members.
|
|
|
127 |
|
128 |
+
| Type | Misc | Author |
|
129 |
+
| ----- | ----- | ----- |
|
130 |
+
| [GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main) | | alchemonaut |
|
131 |
+
| [GGUF](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF) | iMat | Nexesenex |
|
132 |
+
| [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2) | 2.5bpw | llmixer |
|
133 |
+
| [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2) | 4.0bpw| llmixer |
|
134 |
+
| [exl2](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2) | 6.0bpw | llmixer |
|
135 |
+
| [AWQ](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ) | | tachyphylaxis |
|
136 |
|
137 |
|
|
|
|
|
138 |
<br/>
|
139 |
<br/>
|
140 |
|