Update README.md
Browse files
README.md
CHANGED
@@ -5,14 +5,15 @@
|
|
5 |
|
6 |
[Imatrix](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/Imatrix/imatrix-MiquMaid-c2000-ctx500-wikitext.dat) generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
|
7 |
|
|
|
|
|
8 |
## Other quants:
|
|
|
9 |
EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
|
10 |
|
11 |
GGUF:
|
12 |
|
13 |
-
[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF)
|
14 |
-
|
15 |
-
[NeverSleeps Official Quants](https://huggingface.co/NeverSleep/MiquMaid-v1-70B-GGUF)
|
16 |
|
17 |
### Custom format:
|
18 |
```
|
@@ -27,4 +28,6 @@ GGUF:
|
|
27 |
```
|
28 |
|
29 |
## Contact
|
30 |
-
Kooten on discord
|
|
|
|
|
|
5 |
|
6 |
[Imatrix](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/Imatrix/imatrix-MiquMaid-c2000-ctx500-wikitext.dat) generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
|
7 |
|
8 |
+
These quants take a while to do so please leave a like or a comment on the repo so that i know if there is interest.
|
9 |
+
|
10 |
## Other quants:
|
11 |
+
|
12 |
EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
|
13 |
|
14 |
GGUF:
|
15 |
|
16 |
+
[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF): [XS](), [XXS]()
|
|
|
|
|
17 |
|
18 |
### Custom format:
|
19 |
```
|
|
|
28 |
```
|
29 |
|
30 |
## Contact
|
31 |
+
Kooten on discord
|
32 |
+
|
33 |
+
[ko-fi.com/kooten](https://ko-fi.com/kooten)
|