Commit
•
144603c
1
Parent(s):
03d2730
Update README.md
Browse files
README.md
CHANGED
|
@@ -16,4 +16,21 @@ This model is a finetune of [macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo](https:
|
|
| 16 |
|
| 17 |
## GGUF
|
| 18 |
|
| 19 |
-
Available [here](https://huggingface.co/macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo-GGUF)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
## GGUF
|
| 18 |
|
| 19 |
+
Available [here](https://huggingface.co/macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo-GGUF)
|
| 20 |
+
|
| 21 |
+
## Evaluations
|
| 22 |
+
|
| 23 |
+
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
| 24 |
+
|-------------|-------|------|-----:|--------|-----:|---|-----:|
|
| 25 |
+
|arc_challenge|Yaml |none | 0|acc |0.5853|± |0.0144|
|
| 26 |
+
| | |none | 0|acc_norm|0.6126|± |0.0142|
|
| 27 |
+
|arc_easy |Yaml |none | 0|acc |0.8077|± |0.0081|
|
| 28 |
+
| | |none | 0|acc_norm|0.7715|± |0.0086|
|
| 29 |
+
|boolq |Yaml |none | 0|acc |0.8630|± |0.0060|
|
| 30 |
+
|hellaswag |Yaml |none | 0|acc |0.6653|± |0.0047|
|
| 31 |
+
| | |none | 0|acc_norm|0.8498|± |0.0036|
|
| 32 |
+
|openbookqa |Yaml |none | 0|acc |0.3460|± |0.0213|
|
| 33 |
+
| | |none | 0|acc_norm|0.4660|± |0.0223|
|
| 34 |
+
|piqa |Yaml |none | 0|acc |0.7835|± |0.0096|
|
| 35 |
+
| | |none | 0|acc_norm|0.7851|± |0.0096|
|
| 36 |
+
|winogrande |Yaml |none | 0|acc |0.7277|± |0.0125|
|