xxx777xxxASD
commited on
Commit
•
62661c0
1
Parent(s):
2283c65
Update README.md
Browse files
README.md
CHANGED
@@ -13,8 +13,11 @@ Experimental MoE, the idea is to have more active parameters than 7xX model woul
|
|
13 |
|
14 |
This model has ~19.2B parameters. For some odd reason, the model was not given the "Safetensors" tag, so the number of parameters is not displayed.
|
15 |
|
16 |
-
[Exl2, 4.0 bpw](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0)
|
17 |
-
|
|
|
|
|
|
|
18 |
|
19 |
### Base model (self merge)
|
20 |
```
|
|
|
13 |
|
14 |
This model has ~19.2B parameters. For some odd reason, the model was not given the "Safetensors" tag, so the number of parameters is not displayed.
|
15 |
|
16 |
+
[Exl2, 4.0 bpw](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0) (Fits in 12GB VRAM/16k context/4-bit cache)
|
17 |
+
|
18 |
+
[Exl2, 6.0 bpw](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-6.0)
|
19 |
+
|
20 |
+
[GGUF](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-GGUF)
|
21 |
|
22 |
### Base model (self merge)
|
23 |
```
|