Lewdiculous
commited on
Commit
•
5d45a80
1
Parent(s):
5f6b68d
Update README.md
Browse files
README.md
CHANGED
@@ -4,8 +4,12 @@ tags:
|
|
4 |
- merge
|
5 |
- roleplay
|
6 |
---
|
7 |
-
This repository
|
8 |
|
9 |
-
|
10 |
-
|
11 |
-
|
|
|
|
|
|
|
|
|
|
4 |
- merge
|
5 |
- roleplay
|
6 |
---
|
7 |
+
This repository hosts GGUF-IQ-Imatrix quantizations for [Virt-io/FuseChat-Kunoichi-10.7B](https://huggingface.co/Virt-io/FuseChat-Kunoichi-10.7B).
|
8 |
|
9 |
+
Uploading quants...
|
10 |
+
```python
|
11 |
+
quantization_options = [
|
12 |
+
"Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M",
|
13 |
+
"Q5_K_S", "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XS", "IQ3_XXS"
|
14 |
+
]
|
15 |
+
```
|