JeongwonChoi
commited on
Commit
•
daf5137
1
Parent(s):
a02b908
Update README.md
Browse files
README.md
CHANGED
@@ -50,15 +50,13 @@ text = """\
|
|
50 |
|
51 |
### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
52 |
|
53 |
-
|
54 |
-
|
55 |
-
|
|
56 |
-
|
|
57 |
-
|
|
58 |
-
|
|
59 |
-
|
|
60 |
-
| kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
|
61 |
-
| **Average** | **0.0** | **0.0** | **0.0** | **0.0** |
|
62 |
|
63 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
64 |
|
|
|
50 |
|
51 |
### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
52 |
|
53 |
+
| Task | 0-shot | 5-shot | 10-shot | 50-shot |
|
54 |
+
| :--------------- | -----------: | -----------: | -----------: | ----------: |
|
55 |
+
| kobest_boolq | 0.86665 | 0.932254 | 0.940132 | 0.941561 |
|
56 |
+
| kobest_copa | 0.723415 | 0.780594 | 0.778814 | 0.79982 |
|
57 |
+
| kobest_hellaswag | 0.471639 | 0.466883 | 0.472548 | 0.488648 |
|
58 |
+
| kobest_sentineg | 0.78514 | 0.964734 | 0.972281 | 0.972289 |
|
59 |
+
| **Average** | **0.711711** | **0.786116** | **0.790944** | **0.80058** |
|
|
|
|
|
60 |
|
61 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
62 |
|