Update README.md
Browse files
README.md
CHANGED
@@ -16,66 +16,40 @@ datasets:
|
|
16 |
- mlabonne/chatml_dpo_pairs
|
17 |
base_model: JackFram/llama-68m
|
18 |
widget:
|
19 |
-
-
|
20 |
-
|
21 |
-
You are a
|
22 |
-
|
23 |
-
|
24 |
-
|
25 |
-
|
26 |
-
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
Hi!
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
I
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
-
|
52 |
-
|
53 |
-
You are a helpful assistant who provides concise responses.<|im_end|>
|
54 |
-
|
55 |
-
<|im_start|>user
|
56 |
-
|
57 |
-
Hi!<|im_end|>
|
58 |
-
|
59 |
-
<|im_start|>assistant
|
60 |
-
|
61 |
-
Hello there! How may I help you?<|im_end|>
|
62 |
-
|
63 |
-
<|im_start|>user
|
64 |
-
|
65 |
-
I need to build a simple website. Where should I start learning about web development?<|im_end|>
|
66 |
-
|
67 |
-
<|im_start|>assistant'
|
68 |
-
- text: '<|im_start|>system
|
69 |
-
|
70 |
-
You are a very creative assistant. User will give you a task, which you should
|
71 |
-
complete with all your knowledge.<|im_end|>
|
72 |
-
|
73 |
-
<|im_start|>user
|
74 |
-
|
75 |
-
Write the background story of an RPG game about wizards and dragons in a sci-fi
|
76 |
-
world.<|im_end|>
|
77 |
-
|
78 |
-
<|im_start|>assistant'
|
79 |
inference:
|
80 |
parameters:
|
81 |
max_new_tokens: 64
|
@@ -220,7 +194,8 @@ penalty_alpha: 0.5
|
|
220 |
top_k: 4
|
221 |
```
|
222 |
|
223 |
-
|
|
|
224 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Llama-68M-Chat-v1)
|
225 |
|
226 |
| Metric |Value|
|
@@ -232,4 +207,3 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
|
|
232 |
|TruthfulQA (0-shot) |47.27|
|
233 |
|Winogrande (5-shot) |54.30|
|
234 |
|GSM8k (5-shot) | 0.00|
|
235 |
-
|
|
|
16 |
- mlabonne/chatml_dpo_pairs
|
17 |
base_model: JackFram/llama-68m
|
18 |
widget:
|
19 |
+
- messages:
|
20 |
+
- role: system
|
21 |
+
content: You are a career counselor. The user will provide you with an individual
|
22 |
+
looking for guidance in their professional life, and your task is to assist
|
23 |
+
them in determining what careers they are most suited for based on their skills,
|
24 |
+
interests, and experience. You should also conduct research into the various
|
25 |
+
options available, explain the job market trends in different industries, and
|
26 |
+
advice on which qualifications would be beneficial for pursuing particular fields.
|
27 |
+
- role: user
|
28 |
+
content: Heya!
|
29 |
+
- role: assistant
|
30 |
+
content: Hi! How may I help you?
|
31 |
+
- role: user
|
32 |
+
content: I am interested in developing a career in software engineering. What
|
33 |
+
would you recommend me to do?
|
34 |
+
- messages:
|
35 |
+
- role: system
|
36 |
+
content: You are a knowledgeable assistant. Help the user as much as you can.
|
37 |
+
- role: user
|
38 |
+
content: How to become healthier?
|
39 |
+
- messages:
|
40 |
+
- role: system
|
41 |
+
content: You are a helpful assistant who provides concise responses.
|
42 |
+
- role: user
|
43 |
+
content: Hi!
|
44 |
+
- role: assistant
|
45 |
+
content: Hello there! How may I help you?
|
46 |
+
- role: user
|
47 |
+
content: I need to build a simple website. Where should I start learning about web development?
|
48 |
+
- messages:
|
49 |
+
- role: system
|
50 |
+
content: You are a very creative assistant. User will give you a task, which you should complete with all your knowledge.
|
51 |
+
- role: user
|
52 |
+
content: Write the background story of an RPG game about wizards and dragons in a sci-fi world.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
53 |
inference:
|
54 |
parameters:
|
55 |
max_new_tokens: 64
|
|
|
194 |
top_k: 4
|
195 |
```
|
196 |
|
197 |
+
## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
198 |
+
|
199 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Llama-68M-Chat-v1)
|
200 |
|
201 |
| Metric |Value|
|
|
|
207 |
|TruthfulQA (0-shot) |47.27|
|
208 |
|Winogrande (5-shot) |54.30|
|
209 |
|GSM8k (5-shot) | 0.00|
|
|