migtissera leaderboard-pr-bot commited on
Commit
89d1067
1 Parent(s): 0435e63

Adding Evaluation Results (#6)

Browse files

- Adding Evaluation Results (29f646e44e9940288aa7a8c7aeaba1e305179a4d)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +109 -0
README.md CHANGED
@@ -2,6 +2,101 @@
2
  license: other
3
  license_name: qwen2
4
  license_link: https://huggingface.co/Qwen/Qwen2-72B/blob/main/LICENSE
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # Tess-v2.5.2 (Qwen2-72B)
@@ -118,3 +213,17 @@ While this model aims for accuracy, it can occasionally produce inaccurate or mi
118
  Despite diligent efforts in refining the pretraining data, there remains a possibility for the generation of inappropriate, biased, or offensive content.
119
 
120
  Exercise caution and cross-check information when necessary. This is an uncensored model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
  license_name: qwen2
4
  license_link: https://huggingface.co/Qwen/Qwen2-72B/blob/main/LICENSE
5
+ model-index:
6
+ - name: Tess-v2.5.2-Qwen2-72B
7
+ results:
8
+ - task:
9
+ type: text-generation
10
+ name: Text Generation
11
+ dataset:
12
+ name: IFEval (0-Shot)
13
+ type: HuggingFaceH4/ifeval
14
+ args:
15
+ num_few_shot: 0
16
+ metrics:
17
+ - type: inst_level_strict_acc and prompt_level_strict_acc
18
+ value: 44.94
19
+ name: strict accuracy
20
+ source:
21
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
22
+ name: Open LLM Leaderboard
23
+ - task:
24
+ type: text-generation
25
+ name: Text Generation
26
+ dataset:
27
+ name: BBH (3-Shot)
28
+ type: BBH
29
+ args:
30
+ num_few_shot: 3
31
+ metrics:
32
+ - type: acc_norm
33
+ value: 52.31
34
+ name: normalized accuracy
35
+ source:
36
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
37
+ name: Open LLM Leaderboard
38
+ - task:
39
+ type: text-generation
40
+ name: Text Generation
41
+ dataset:
42
+ name: MATH Lvl 5 (4-Shot)
43
+ type: hendrycks/competition_math
44
+ args:
45
+ num_few_shot: 4
46
+ metrics:
47
+ - type: exact_match
48
+ value: 27.42
49
+ name: exact match
50
+ source:
51
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
52
+ name: Open LLM Leaderboard
53
+ - task:
54
+ type: text-generation
55
+ name: Text Generation
56
+ dataset:
57
+ name: GPQA (0-shot)
58
+ type: Idavidrein/gpqa
59
+ args:
60
+ num_few_shot: 0
61
+ metrics:
62
+ - type: acc_norm
63
+ value: 13.42
64
+ name: acc_norm
65
+ source:
66
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
67
+ name: Open LLM Leaderboard
68
+ - task:
69
+ type: text-generation
70
+ name: Text Generation
71
+ dataset:
72
+ name: MuSR (0-shot)
73
+ type: TAUR-Lab/MuSR
74
+ args:
75
+ num_few_shot: 0
76
+ metrics:
77
+ - type: acc_norm
78
+ value: 10.89
79
+ name: acc_norm
80
+ source:
81
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
82
+ name: Open LLM Leaderboard
83
+ - task:
84
+ type: text-generation
85
+ name: Text Generation
86
+ dataset:
87
+ name: MMLU-PRO (5-shot)
88
+ type: TIGER-Lab/MMLU-Pro
89
+ config: main
90
+ split: test
91
+ args:
92
+ num_few_shot: 5
93
+ metrics:
94
+ - type: acc
95
+ value: 50.68
96
+ name: accuracy
97
+ source:
98
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=migtissera/Tess-v2.5.2-Qwen2-72B
99
+ name: Open LLM Leaderboard
100
  ---
101
 
102
  # Tess-v2.5.2 (Qwen2-72B)
 
213
  Despite diligent efforts in refining the pretraining data, there remains a possibility for the generation of inappropriate, biased, or offensive content.
214
 
215
  Exercise caution and cross-check information when necessary. This is an uncensored model.
216
+
217
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
218
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_migtissera__Tess-v2.5.2-Qwen2-72B)
219
+
220
+ | Metric |Value|
221
+ |-------------------|----:|
222
+ |Avg. |33.28|
223
+ |IFEval (0-Shot) |44.94|
224
+ |BBH (3-Shot) |52.31|
225
+ |MATH Lvl 5 (4-Shot)|27.42|
226
+ |GPQA (0-shot) |13.42|
227
+ |MuSR (0-shot) |10.89|
228
+ |MMLU-PRO (5-shot) |50.68|
229
+