dahye1 commited on
Commit
c9e09ae
1 Parent(s): 22b9989

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -3,11 +3,15 @@ license: cc-by-4.0
3
  ---
4
  # **KoQuality-Polyglot-5.8b**
5
 
6
- KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instruction tuning with KoQuality datasets on Polyglot-5.8b model.
7
 
8
- <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/U7fLI5xFm23kosszXtyLP.png style="max-width: 500px; width: 300%"/>
9
 
 
10
 
 
 
 
 
11
 
12
 
13
  | Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
@@ -18,6 +22,8 @@ KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instr
18
  | kullm-polyglot-5.8b | 0.5409 | 0.6072 | 0.5945 | 0.6345 | 0.6530
19
 
20
 
 
 
21
  <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/7EKl1OAgKgPBFcSlGzBiW.png style="max-width: 800px; width: 400%"/>
22
 
23
 
 
3
  ---
4
  # **KoQuality-Polyglot-5.8b**
5
 
 
6
 
7
+ KoQuality-Polyglot-5.8b is an auto-regressive language model that conducts instruction tuning with KoQuality datasets on Polyglot-5.8b model.
8
 
9
+ ### Average accuracy score of the KoBEST datasets
10
 
11
+ Our best model is trained on [KoQuality dataset](https://huggingface.co/datasets/DILAB-HYU/KoQuality), which is curated by proposed method (len_group=5, k=100, method=ppl_sampling). <br>
12
+ We use KoBEST benchmark datasets(KoBEST_boolq, KoBEST_copa, KoBEST_hellaswag, KoBEST_sentineg, KoBEST_wic) to compare the performance of our best model and other models accuracy. <br>
13
+ Our model outperforms other models in the average accuracy score of the KoBEST datasets.
14
+ <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/U7fLI5xFm23kosszXtyLP.png style="max-width: 500px; width: 300%"/>
15
 
16
 
17
  | Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
 
22
  | kullm-polyglot-5.8b | 0.5409 | 0.6072 | 0.5945 | 0.6345 | 0.6530
23
 
24
 
25
+
26
+
27
  <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/7EKl1OAgKgPBFcSlGzBiW.png style="max-width: 800px; width: 400%"/>
28
 
29