Commit
•
8beef73
1
Parent(s):
4842c64
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,12 +2,14 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
(Maybe i'll change the icon picture later.)
|
| 8 |
|
| 9 |
Experimental MoE, the idea is to have more active parameters than 7xX model would have and keep it's size lower than 20B.
|
| 10 |
-
This model has ~19.2B parameters
|
| 11 |
|
| 12 |
### Base model (self merge)
|
| 13 |
```
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
+
tags:
|
| 6 |
+
- merge
|
| 7 |
---
|
| 8 |
|
| 9 |
(Maybe i'll change the icon picture later.)
|
| 10 |
|
| 11 |
Experimental MoE, the idea is to have more active parameters than 7xX model would have and keep it's size lower than 20B.
|
| 12 |
+
This model has ~19.2B parameters. For some odd reason, the model was not given the "Safetensors" tag, so the number of parameters is not displayed.
|
| 13 |
|
| 14 |
### Base model (self merge)
|
| 15 |
```
|