Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,16 @@ library_name: transformers
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
This model was created with the help of several members of Anthracite.
|
| 10 |
|
| 11 |
This is a 4B parameter Minitron derivative healed, instruct tuned, and then further tuned on 20M tokens of human, synthetic, and hybrid data. This model was tuned at 16k context during all steps. This model should perform well as a general assistant and RP model.
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
| 9 |
+
```
|
| 10 |
+
| Groups |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 11 |
+
|------------------|------:|------|------|------|---|-----:|---|-----:|
|
| 12 |
+
|mmlu | 2|none | |acc |_ |0.5847|_ |0.0039|
|
| 13 |
+
| - humanities | 2|none | |acc |_ |0.5345|_ |0.0068|
|
| 14 |
+
| - other | 2|none | |acc |_ |0.6482|_ |0.0082|
|
| 15 |
+
| - social sciences| 2|none | |acc |_ |0.6822|_ |0.0082|
|
| 16 |
+
| - stem | 2|none | |acc |_ |0.5021|_ |0.0086|
|
| 17 |
+
```
|
| 18 |
+
|
| 19 |
This model was created with the help of several members of Anthracite.
|
| 20 |
|
| 21 |
This is a 4B parameter Minitron derivative healed, instruct tuned, and then further tuned on 20M tokens of human, synthetic, and hybrid data. This model was tuned at 16k context during all steps. This model should perform well as a general assistant and RP model.
|