Update README.md
Browse files
README.md
CHANGED
@@ -3,11 +3,15 @@ license: cc-by-4.0
|
|
3 |
---
|
4 |
# **KoQuality-Polyglot-5.8b**
|
5 |
|
6 |
-
KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instruction tuning with KoQuality datasets on Polyglot-5.8b model.
|
7 |
|
8 |
-
|
9 |
|
|
|
10 |
|
|
|
|
|
|
|
|
|
11 |
|
12 |
|
13 |
| Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
|
@@ -18,6 +22,8 @@ KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instr
|
|
18 |
| kullm-polyglot-5.8b | 0.5409 | 0.6072 | 0.5945 | 0.6345 | 0.6530
|
19 |
|
20 |
|
|
|
|
|
21 |
<img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/7EKl1OAgKgPBFcSlGzBiW.png style="max-width: 800px; width: 400%"/>
|
22 |
|
23 |
|
|
|
3 |
---
|
4 |
# **KoQuality-Polyglot-5.8b**
|
5 |
|
|
|
6 |
|
7 |
+
KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instruction tuning with KoQuality datasets on Polyglot-5.8b model.
|
8 |
|
9 |
+
### Average accuracy score of the KoBEST datasets
|
10 |
|
11 |
+
Our best model is trained on [KoQuality dataset](https://huggingface.co/datasets/DILAB-HYU/KoQuality), which is curated by proposed method (len_group=5, k=100, method=ppl_sampling). <br>
|
12 |
+
We use KoBEST benchmark datasets(KoBEST_boolq, KoBEST_copa, KoBEST_hellaswag, KoBEST_sentineg, KoBEST_wic) to compare the performance of our best model and other models accuracy. <br>
|
13 |
+
Our model outperforms other models in the average accuracy score of the KoBEST datasets.
|
14 |
+
<img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/U7fLI5xFm23kosszXtyLP.png style="max-width: 500px; width: 300%"/>
|
15 |
|
16 |
|
17 |
| Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
|
|
|
22 |
| kullm-polyglot-5.8b | 0.5409 | 0.6072 | 0.5945 | 0.6345 | 0.6530
|
23 |
|
24 |
|
25 |
+
|
26 |
+
|
27 |
<img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/7EKl1OAgKgPBFcSlGzBiW.png style="max-width: 800px; width: 400%"/>
|
28 |
|
29 |
|