Commit
•
b5a12d9
1
Parent(s):
aabb745
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
|
@@ -229,4 +229,17 @@ GGUF Quants: https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B-GGUF
|
|
| 229 |
primaryClass={cs.CL},
|
| 230 |
url={https://arxiv.org/abs/2408.11857},
|
| 231 |
}
|
| 232 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 229 |
primaryClass={cs.CL},
|
| 230 |
url={https://arxiv.org/abs/2408.11857},
|
| 231 |
}
|
| 232 |
+
```
|
| 233 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
| 234 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NousResearch__Hermes-3-Llama-3.1-8B)
|
| 235 |
+
|
| 236 |
+
| Metric |Value|
|
| 237 |
+
|-------------------|----:|
|
| 238 |
+
|Avg. |23.49|
|
| 239 |
+
|IFEval (0-Shot) |61.70|
|
| 240 |
+
|BBH (3-Shot) |30.72|
|
| 241 |
+
|MATH Lvl 5 (4-Shot)| 4.76|
|
| 242 |
+
|GPQA (0-shot) | 6.38|
|
| 243 |
+
|MuSR (0-shot) |13.62|
|
| 244 |
+
|MMLU-PRO (5-shot) |23.77|
|
| 245 |
+
|