Hugging Face's logo

sometimesanotion
/
Lamarck-14B-v0.3

Text Generation
Transformers
Safetensors
English
qwen2
mergekit
Merge
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1
sometimesanotion commited on
Commit
b3dd314
•
1 Parent(s): cb5c8bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -9
README.md CHANGED
@@ -33,7 +33,8 @@ model-index:
33
  value: 50.32
34
  name: strict accuracy
35
  source:
36
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
37
  name: Open LLM Leaderboard
38
  - task:
39
  type: text-generation
@@ -48,7 +49,8 @@ model-index:
48
  value: 51.27
49
  name: normalized accuracy
50
  source:
51
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
52
  name: Open LLM Leaderboard
53
  - task:
54
  type: text-generation
@@ -63,7 +65,8 @@ model-index:
63
  value: 32.4
64
  name: exact match
65
  source:
66
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
67
  name: Open LLM Leaderboard
68
  - task:
69
  type: text-generation
@@ -78,7 +81,8 @@ model-index:
78
  value: 18.46
79
  name: acc_norm
80
  source:
81
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
82
  name: Open LLM Leaderboard
83
  - task:
84
  type: text-generation
@@ -90,10 +94,11 @@ model-index:
90
  num_few_shot: 0
91
  metrics:
92
  - type: acc_norm
93
- value: 18.0
94
  name: acc_norm
95
  source:
96
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
97
  name: Open LLM Leaderboard
98
  - task:
99
  type: text-generation
@@ -110,8 +115,10 @@ model-index:
110
  value: 49.01
111
  name: accuracy
112
  source:
113
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
 
114
  name: Open LLM Leaderboard
 
115
  ---
116
  ![Lamarck.webp](https://huggingface.co/sometimesanotion/Lamarck-14B-v0.3/resolve/main/Lamarck.webp)
117
  ---
@@ -173,5 +180,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
173
  |MATH Lvl 5 (4-Shot)|32.40|
174
  |GPQA (0-shot) |18.46|
175
  |MuSR (0-shot) |18.00|
176
- |MMLU-PRO (5-shot) |49.01|
177
-
 
33
  value: 50.32
34
  name: strict accuracy
35
  source:
36
+ url: >-
37
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
38
  name: Open LLM Leaderboard
39
  - task:
40
  type: text-generation
 
49
  value: 51.27
50
  name: normalized accuracy
51
  source:
52
+ url: >-
53
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
54
  name: Open LLM Leaderboard
55
  - task:
56
  type: text-generation
 
65
  value: 32.4
66
  name: exact match
67
  source:
68
+ url: >-
69
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
70
  name: Open LLM Leaderboard
71
  - task:
72
  type: text-generation
 
81
  value: 18.46
82
  name: acc_norm
83
  source:
84
+ url: >-
85
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
86
  name: Open LLM Leaderboard
87
  - task:
88
  type: text-generation
 
94
  num_few_shot: 0
95
  metrics:
96
  - type: acc_norm
97
+ value: 18
98
  name: acc_norm
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 49.01
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sometimesanotion/Lamarck-14B-v0.3
120
  name: Open LLM Leaderboard
121
+ new_version: sometimesanotion/Lamarck-14B-v0.4-Qwenvergence
122
  ---
123
  ![Lamarck.webp](https://huggingface.co/sometimesanotion/Lamarck-14B-v0.3/resolve/main/Lamarck.webp)
124
  ---
 
180
  |MATH Lvl 5 (4-Shot)|32.40|
181
  |GPQA (0-shot) |18.46|
182
  |MuSR (0-shot) |18.00|
183
+ |MMLU-PRO (5-shot) |49.01|