Commit
•
db9f3fa
1
Parent(s):
a100353
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,9 @@ Experimental MoE, the idea is to have more active parameters than 7xX model woul
|
|
| 12 |
|
| 13 |
This model has ~19.2B parameters. For some odd reason, the model was not given the "Safetensors" tag, so the number of parameters is not displayed.
|
| 14 |
|
|
|
|
|
|
|
|
|
|
| 15 |
### Base model (self merge)
|
| 16 |
```
|
| 17 |
slices:
|
|
|
|
| 12 |
|
| 13 |
This model has ~19.2B parameters. For some odd reason, the model was not given the "Safetensors" tag, so the number of parameters is not displayed.
|
| 14 |
|
| 15 |
+
[Exl2, 4.0 bpw](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0)
|
| 16 |
+
(Fits in 12GB VRAM/14k context/4-bit cache)
|
| 17 |
+
|
| 18 |
### Base model (self merge)
|
| 19 |
```
|
| 20 |
slices:
|