Files changed (1) hide show
  1. README.md +0 -131
README.md CHANGED
@@ -2,109 +2,6 @@
2
  license: other
3
  task_categories:
4
  - text-generation
5
- model-index:
6
- - name: dolphin-llama-13b
7
- results:
8
- - task:
9
- type: text-generation
10
- name: Text Generation
11
- dataset:
12
- name: AI2 Reasoning Challenge (25-Shot)
13
- type: ai2_arc
14
- config: ARC-Challenge
15
- split: test
16
- args:
17
- num_few_shot: 25
18
- metrics:
19
- - type: acc_norm
20
- value: 55.55
21
- name: normalized accuracy
22
- source:
23
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
24
- name: Open LLM Leaderboard
25
- - task:
26
- type: text-generation
27
- name: Text Generation
28
- dataset:
29
- name: HellaSwag (10-Shot)
30
- type: hellaswag
31
- split: validation
32
- args:
33
- num_few_shot: 10
34
- metrics:
35
- - type: acc_norm
36
- value: 77.11
37
- name: normalized accuracy
38
- source:
39
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
40
- name: Open LLM Leaderboard
41
- - task:
42
- type: text-generation
43
- name: Text Generation
44
- dataset:
45
- name: MMLU (5-Shot)
46
- type: cais/mmlu
47
- config: all
48
- split: test
49
- args:
50
- num_few_shot: 5
51
- metrics:
52
- - type: acc
53
- value: 52.16
54
- name: accuracy
55
- source:
56
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
57
- name: Open LLM Leaderboard
58
- - task:
59
- type: text-generation
60
- name: Text Generation
61
- dataset:
62
- name: TruthfulQA (0-shot)
63
- type: truthful_qa
64
- config: multiple_choice
65
- split: validation
66
- args:
67
- num_few_shot: 0
68
- metrics:
69
- - type: mc2
70
- value: 52.23
71
- source:
72
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
73
- name: Open LLM Leaderboard
74
- - task:
75
- type: text-generation
76
- name: Text Generation
77
- dataset:
78
- name: Winogrande (5-shot)
79
- type: winogrande
80
- config: winogrande_xl
81
- split: validation
82
- args:
83
- num_few_shot: 5
84
- metrics:
85
- - type: acc
86
- value: 69.93
87
- name: accuracy
88
- source:
89
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
90
- name: Open LLM Leaderboard
91
- - task:
92
- type: text-generation
93
- name: Text Generation
94
- dataset:
95
- name: GSM8k (5-shot)
96
- type: gsm8k
97
- config: main
98
- split: test
99
- args:
100
- num_few_shot: 5
101
- metrics:
102
- - type: acc
103
- value: 14.4
104
- name: accuracy
105
- source:
106
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ehartford/dolphin-llama-13b
107
- name: Open LLM Leaderboard
108
  ---
109
 
110
  Dolphin 🐬
@@ -197,31 +94,3 @@ ASSISTANT:
197
  9. Conservation status: Many dolphin species face threats due to habitat loss, pollution, overfishing, and climate change. As a result, several populations are considered vulnerable or endangered by the International Union for Conservation of Nature (IUCN). In comparison, orca conservation status varies depending on the region; however, no species is currently listed as critically endangered or facing extinction.
198
 
199
  10. Adaptability: Dolphins have adapted to various aquatic environments, ranging from warm coastal waters to colder open oceans. Their versatility allows them to thrive in both tropical and temperate climates. Orcas, conversely, are adapted to specific habitats such as cooler coastal waters and are mostly found in the Northern Hemisphere.
200
-
201
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
202
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ehartford__dolphin-llama-13b)
203
-
204
- | Metric | Value |
205
- |-----------------------|---------------------------|
206
- | Avg. | 48.6 |
207
- | ARC (25-shot) | 55.55 |
208
- | HellaSwag (10-shot) | 77.11 |
209
- | MMLU (5-shot) | 52.16 |
210
- | TruthfulQA (0-shot) | 52.23 |
211
- | Winogrande (5-shot) | 69.93 |
212
- | GSM8K (5-shot) | 14.4 |
213
- | DROP (3-shot) | 18.83 |
214
-
215
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
216
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ehartford__dolphin-llama-13b)
217
-
218
- | Metric |Value|
219
- |---------------------------------|----:|
220
- |Avg. |53.56|
221
- |AI2 Reasoning Challenge (25-Shot)|55.55|
222
- |HellaSwag (10-Shot) |77.11|
223
- |MMLU (5-Shot) |52.16|
224
- |TruthfulQA (0-shot) |52.23|
225
- |Winogrande (5-shot) |69.93|
226
- |GSM8k (5-shot) |14.40|
227
-
 
2
  license: other
3
  task_categories:
4
  - text-generation
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  Dolphin 🐬
 
94
  9. Conservation status: Many dolphin species face threats due to habitat loss, pollution, overfishing, and climate change. As a result, several populations are considered vulnerable or endangered by the International Union for Conservation of Nature (IUCN). In comparison, orca conservation status varies depending on the region; however, no species is currently listed as critically endangered or facing extinction.
95
 
96
  10. Adaptability: Dolphins have adapted to various aquatic environments, ranging from warm coastal waters to colder open oceans. Their versatility allows them to thrive in both tropical and temperate climates. Orcas, conversely, are adapted to specific habitats such as cooler coastal waters and are mostly found in the Northern Hemisphere.