123456
#5
by
maike8888
- opened
README.md
CHANGED
@@ -2,109 +2,6 @@
|
|
2 |
license: other
|
3 |
task_categories:
|
4 |
- text-generation
|
5 |
-
model-index:
|
6 |
-
- name: dolphin-llama-13b
|
7 |
-
results:
|
8 |
-
- task:
|
9 |
-
type: text-generation
|
10 |
-
name: Text Generation
|
11 |
-
dataset:
|
12 |
-
name: AI2 Reasoning Challenge (25-Shot)
|
13 |
-
type: ai2_arc
|
14 |
-
config: ARC-Challenge
|
15 |
-
split: test
|
16 |
-
args:
|
17 |
-
num_few_shot: 25
|
18 |
-
metrics:
|
19 |
-
- type: acc_norm
|
20 |
-
value: 55.55
|
21 |
-
name: normalized accuracy
|
22 |
-
source:
|
23 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
24 |
-
name: Open LLM Leaderboard
|
25 |
-
- task:
|
26 |
-
type: text-generation
|
27 |
-
name: Text Generation
|
28 |
-
dataset:
|
29 |
-
name: HellaSwag (10-Shot)
|
30 |
-
type: hellaswag
|
31 |
-
split: validation
|
32 |
-
args:
|
33 |
-
num_few_shot: 10
|
34 |
-
metrics:
|
35 |
-
- type: acc_norm
|
36 |
-
value: 77.11
|
37 |
-
name: normalized accuracy
|
38 |
-
source:
|
39 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
40 |
-
name: Open LLM Leaderboard
|
41 |
-
- task:
|
42 |
-
type: text-generation
|
43 |
-
name: Text Generation
|
44 |
-
dataset:
|
45 |
-
name: MMLU (5-Shot)
|
46 |
-
type: cais/mmlu
|
47 |
-
config: all
|
48 |
-
split: test
|
49 |
-
args:
|
50 |
-
num_few_shot: 5
|
51 |
-
metrics:
|
52 |
-
- type: acc
|
53 |
-
value: 52.16
|
54 |
-
name: accuracy
|
55 |
-
source:
|
56 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
57 |
-
name: Open LLM Leaderboard
|
58 |
-
- task:
|
59 |
-
type: text-generation
|
60 |
-
name: Text Generation
|
61 |
-
dataset:
|
62 |
-
name: TruthfulQA (0-shot)
|
63 |
-
type: truthful_qa
|
64 |
-
config: multiple_choice
|
65 |
-
split: validation
|
66 |
-
args:
|
67 |
-
num_few_shot: 0
|
68 |
-
metrics:
|
69 |
-
- type: mc2
|
70 |
-
value: 52.23
|
71 |
-
source:
|
72 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
73 |
-
name: Open LLM Leaderboard
|
74 |
-
- task:
|
75 |
-
type: text-generation
|
76 |
-
name: Text Generation
|
77 |
-
dataset:
|
78 |
-
name: Winogrande (5-shot)
|
79 |
-
type: winogrande
|
80 |
-
config: winogrande_xl
|
81 |
-
split: validation
|
82 |
-
args:
|
83 |
-
num_few_shot: 5
|
84 |
-
metrics:
|
85 |
-
- type: acc
|
86 |
-
value: 69.93
|
87 |
-
name: accuracy
|
88 |
-
source:
|
89 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
90 |
-
name: Open LLM Leaderboard
|
91 |
-
- task:
|
92 |
-
type: text-generation
|
93 |
-
name: Text Generation
|
94 |
-
dataset:
|
95 |
-
name: GSM8k (5-shot)
|
96 |
-
type: gsm8k
|
97 |
-
config: main
|
98 |
-
split: test
|
99 |
-
args:
|
100 |
-
num_few_shot: 5
|
101 |
-
metrics:
|
102 |
-
- type: acc
|
103 |
-
value: 14.4
|
104 |
-
name: accuracy
|
105 |
-
source:
|
106 |
-
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
|
107 |
-
name: Open LLM Leaderboard
|
108 |
---
|
109 |
|
110 |
Dolphin 🐬
|
@@ -197,31 +94,3 @@ ASSISTANT:
|
|
197 |
9. Conservation status: Many dolphin species face threats due to habitat loss, pollution, overfishing, and climate change. As a result, several populations are considered vulnerable or endangered by the International Union for Conservation of Nature (IUCN). In comparison, orca conservation status varies depending on the region; however, no species is currently listed as critically endangered or facing extinction.
|
198 |
|
199 |
10. Adaptability: Dolphins have adapted to various aquatic environments, ranging from warm coastal waters to colder open oceans. Their versatility allows them to thrive in both tropical and temperate climates. Orcas, conversely, are adapted to specific habitats such as cooler coastal waters and are mostly found in the Northern Hemisphere.
|
200 |
-
|
201 |
-
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
202 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ehartford__dolphin-llama-13b)
|
203 |
-
|
204 |
-
| Metric | Value |
|
205 |
-
|-----------------------|---------------------------|
|
206 |
-
| Avg. | 48.6 |
|
207 |
-
| ARC (25-shot) | 55.55 |
|
208 |
-
| HellaSwag (10-shot) | 77.11 |
|
209 |
-
| MMLU (5-shot) | 52.16 |
|
210 |
-
| TruthfulQA (0-shot) | 52.23 |
|
211 |
-
| Winogrande (5-shot) | 69.93 |
|
212 |
-
| GSM8K (5-shot) | 14.4 |
|
213 |
-
| DROP (3-shot) | 18.83 |
|
214 |
-
|
215 |
-
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
216 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ehartford__dolphin-llama-13b)
|
217 |
-
|
218 |
-
| Metric |Value|
|
219 |
-
|---------------------------------|----:|
|
220 |
-
|Avg. |53.56|
|
221 |
-
|AI2 Reasoning Challenge (25-Shot)|55.55|
|
222 |
-
|HellaSwag (10-Shot) |77.11|
|
223 |
-
|MMLU (5-Shot) |52.16|
|
224 |
-
|TruthfulQA (0-shot) |52.23|
|
225 |
-
|Winogrande (5-shot) |69.93|
|
226 |
-
|GSM8k (5-shot) |14.40|
|
227 |
-
|
|
|
2 |
license: other
|
3 |
task_categories:
|
4 |
- text-generation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
---
|
6 |
|
7 |
Dolphin 🐬
|
|
|
94 |
9. Conservation status: Many dolphin species face threats due to habitat loss, pollution, overfishing, and climate change. As a result, several populations are considered vulnerable or endangered by the International Union for Conservation of Nature (IUCN). In comparison, orca conservation status varies depending on the region; however, no species is currently listed as critically endangered or facing extinction.
|
95 |
|
96 |
10. Adaptability: Dolphins have adapted to various aquatic environments, ranging from warm coastal waters to colder open oceans. Their versatility allows them to thrive in both tropical and temperate climates. Orcas, conversely, are adapted to specific habitats such as cooler coastal waters and are mostly found in the Northern Hemisphere.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|