sophosympatheia
commited on
Commit
•
c0f9a46
1
Parent(s):
7c7060a
Update README.md
Browse filesAdded links to quants
README.md
CHANGED
@@ -179,7 +179,16 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
|
|
179 |
|
180 |
# Quantizations
|
181 |
|
182 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
183 |
|
184 |
# Licence and usage restrictions
|
185 |
|
|
|
179 |
|
180 |
# Quantizations
|
181 |
|
182 |
+
You will find a Exllamav2 measurement file, taken on the default dataset, in the repo if you want to create your own EXL2 quant.
|
183 |
+
|
184 |
+
## Exllamav2 (EXL2)
|
185 |
+
|
186 |
+
* MikeRoz is putting out some EXL2 quants. [Search here](https://huggingface.co/models?sort=trending&search=MikeRoz%2Fsophosympatheia_Evathene).
|
187 |
+
|
188 |
+
## GGUF
|
189 |
+
|
190 |
+
* [mradermacher/Evathene-v1.0-GGUF](https://huggingface.co/mradermacher/Evathene-v1.0-GGUF)
|
191 |
+
* [mradermacher/Evathene-v1.0-i1-GGUF](https://huggingface.co/mradermacher/Evathene-v1.0-i1-GGUF)
|
192 |
|
193 |
# Licence and usage restrictions
|
194 |
|