leaderboard-pr-bot commited on
Commit
47e3395
1 Parent(s): b5502da

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +113 -3
README.md CHANGED
@@ -1,11 +1,11 @@
1
  ---
2
- license: apache-2.0
3
- base_model: speakleash/Bielik-11B-v2
4
  language:
5
  - pl
 
6
  library_name: transformers
7
  tags:
8
  - finetuned
 
9
  inference:
10
  parameters:
11
  temperature: 0.2
@@ -13,7 +13,103 @@ widget:
13
  - messages:
14
  - role: user
15
  content: Co przedstawia polskie godło?
16
- extra_gated_description: If you want to learn more about how you can use the model, please refer to our <a href="https://bielik.ai/terms/">Terms of Use</a>.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ---
18
 
19
  <p align="center">
@@ -408,3 +504,17 @@ Members of the ACK Cyfronet AGH team providing valuable support and expertise:
408
  ## Contact Us
409
 
410
  If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/pv4brQMDTy).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
2
  language:
3
  - pl
4
+ license: apache-2.0
5
  library_name: transformers
6
  tags:
7
  - finetuned
8
+ base_model: speakleash/Bielik-11B-v2
9
  inference:
10
  parameters:
11
  temperature: 0.2
 
13
  - messages:
14
  - role: user
15
  content: Co przedstawia polskie godło?
16
+ extra_gated_description: If you want to learn more about how you can use the model,
17
+ please refer to our <a href="https://bielik.ai/terms/">Terms of Use</a>.
18
+ model-index:
19
+ - name: Bielik-11B-v2.2-Instruct
20
+ results:
21
+ - task:
22
+ type: text-generation
23
+ name: Text Generation
24
+ dataset:
25
+ name: IFEval (0-Shot)
26
+ type: HuggingFaceH4/ifeval
27
+ args:
28
+ num_few_shot: 0
29
+ metrics:
30
+ - type: inst_level_strict_acc and prompt_level_strict_acc
31
+ value: 55.52
32
+ name: strict accuracy
33
+ source:
34
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
35
+ name: Open LLM Leaderboard
36
+ - task:
37
+ type: text-generation
38
+ name: Text Generation
39
+ dataset:
40
+ name: BBH (3-Shot)
41
+ type: BBH
42
+ args:
43
+ num_few_shot: 3
44
+ metrics:
45
+ - type: acc_norm
46
+ value: 36.96
47
+ name: normalized accuracy
48
+ source:
49
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
50
+ name: Open LLM Leaderboard
51
+ - task:
52
+ type: text-generation
53
+ name: Text Generation
54
+ dataset:
55
+ name: MATH Lvl 5 (4-Shot)
56
+ type: hendrycks/competition_math
57
+ args:
58
+ num_few_shot: 4
59
+ metrics:
60
+ - type: exact_match
61
+ value: 7.18
62
+ name: exact match
63
+ source:
64
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
65
+ name: Open LLM Leaderboard
66
+ - task:
67
+ type: text-generation
68
+ name: Text Generation
69
+ dataset:
70
+ name: GPQA (0-shot)
71
+ type: Idavidrein/gpqa
72
+ args:
73
+ num_few_shot: 0
74
+ metrics:
75
+ - type: acc_norm
76
+ value: 10.85
77
+ name: acc_norm
78
+ source:
79
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
80
+ name: Open LLM Leaderboard
81
+ - task:
82
+ type: text-generation
83
+ name: Text Generation
84
+ dataset:
85
+ name: MuSR (0-shot)
86
+ type: TAUR-Lab/MuSR
87
+ args:
88
+ num_few_shot: 0
89
+ metrics:
90
+ - type: acc_norm
91
+ value: 10.11
92
+ name: acc_norm
93
+ source:
94
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
95
+ name: Open LLM Leaderboard
96
+ - task:
97
+ type: text-generation
98
+ name: Text Generation
99
+ dataset:
100
+ name: MMLU-PRO (5-shot)
101
+ type: TIGER-Lab/MMLU-Pro
102
+ config: main
103
+ split: test
104
+ args:
105
+ num_few_shot: 5
106
+ metrics:
107
+ - type: acc
108
+ value: 27.63
109
+ name: accuracy
110
+ source:
111
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=speakleash/Bielik-11B-v2.2-Instruct
112
+ name: Open LLM Leaderboard
113
  ---
114
 
115
  <p align="center">
 
504
  ## Contact Us
505
 
506
  If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/pv4brQMDTy).
507
+
508
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
509
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_speakleash__Bielik-11B-v2.2-Instruct)
510
+
511
+ | Metric |Value|
512
+ |-------------------|----:|
513
+ |Avg. |24.71|
514
+ |IFEval (0-Shot) |55.52|
515
+ |BBH (3-Shot) |36.96|
516
+ |MATH Lvl 5 (4-Shot)| 7.18|
517
+ |GPQA (0-shot) |10.85|
518
+ |MuSR (0-shot) |10.11|
519
+ |MMLU-PRO (5-shot) |27.63|
520
+