leaderboard-pr-bot commited on
Commit
cb4a882
1 Parent(s): a2b71eb

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -74,4 +74,17 @@ The following hyperparameters were used during training:
74
  - Transformers 4.38.0
75
  - Pytorch 2.1.0+cu121
76
  - Datasets 2.17.0
77
- - Tokenizers 0.15.2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
74
  - Transformers 4.38.0
75
  - Pytorch 2.1.0+cu121
76
  - Datasets 2.17.0
77
+ - Tokenizers 0.15.2
78
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
79
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_glenn2__gemma-7b-lora-distilabel-intel-orca-dpo-pairs)
80
+
81
+ | Metric |Value|
82
+ |---------------------------------|----:|
83
+ |Avg. |46.47|
84
+ |AI2 Reasoning Challenge (25-Shot)|49.15|
85
+ |HellaSwag (10-Shot) |71.78|
86
+ |MMLU (5-Shot) |41.52|
87
+ |TruthfulQA (0-shot) |33.10|
88
+ |Winogrande (5-shot) |65.98|
89
+ |GSM8k (5-shot) |17.29|
90
+