Files changed (1) hide show
  1. README.md +36 -15
README.md CHANGED
@@ -1,22 +1,30 @@
1
  ---
2
- license: apache-2.0
3
- base_model: openchat/openchat_3.5
4
- datasets:
5
- - HuggingFaceH4/no_robots
6
  language:
7
  - en
8
- widget:
9
- - text: |
10
- <|system|>
11
- You are a friendly chatbot who always responds in the style of a pirate</s>
12
- <|user|>
13
- How many helicopters can a human eat in one sitting?</s>
14
- <|assistant|>
15
- output:
16
- text: >-
17
- Ahoy there, me hearty! As a friendly pirate chatbot, I be tellin' ye that a human cannot eat a helicopter, as it be a large machine made of metal and suchlike, not fit for human consumption. A human can eat food, like a fine feast of roasted meat and sweet fruits, but a helicopter? That be nonsense, me hearty! So, the answer be none, none at all. Arr!
18
  tags:
19
  - generated_from_trainer
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  pipeline_tag: text-generation
21
  model-index:
22
  - name: smol-7b
@@ -112,4 +120,17 @@ The following hyperparameters were used during training:
112
  journal = {Hugging Face repository},
113
  howpublished = {\url{https://huggingface.co/rishiraj/smol-7b}}
114
  }
115
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
 
 
2
  language:
3
  - en
4
+ license: apache-2.0
 
 
 
 
 
 
 
 
 
5
  tags:
6
  - generated_from_trainer
7
+ datasets:
8
+ - HuggingFaceH4/no_robots
9
+ base_model: openchat/openchat_3.5
10
+ widget:
11
+ - text: '<|system|>
12
+
13
+ You are a friendly chatbot who always responds in the style of a pirate</s>
14
+
15
+ <|user|>
16
+
17
+ How many helicopters can a human eat in one sitting?</s>
18
+
19
+ <|assistant|>
20
+
21
+ '
22
+ output:
23
+ text: Ahoy there, me hearty! As a friendly pirate chatbot, I be tellin' ye that
24
+ a human cannot eat a helicopter, as it be a large machine made of metal and
25
+ suchlike, not fit for human consumption. A human can eat food, like a fine feast
26
+ of roasted meat and sweet fruits, but a helicopter? That be nonsense, me hearty!
27
+ So, the answer be none, none at all. Arr!
28
  pipeline_tag: text-generation
29
  model-index:
30
  - name: smol-7b
 
120
  journal = {Hugging Face repository},
121
  howpublished = {\url{https://huggingface.co/rishiraj/smol-7b}}
122
  }
123
+ ```
124
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
125
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_rishiraj__smol-7b)
126
+
127
+ | Metric |Value|
128
+ |---------------------------------|----:|
129
+ |Avg. |67.11|
130
+ |AI2 Reasoning Challenge (25-Shot)|63.74|
131
+ |HellaSwag (10-Shot) |84.77|
132
+ |MMLU (5-Shot) |65.00|
133
+ |TruthfulQA (0-shot) |46.17|
134
+ |Winogrande (5-shot) |80.66|
135
+ |GSM8k (5-shot) |62.32|
136
+