nayohan commited on
Commit
99826c9
1 Parent(s): c8ab90b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -7,13 +7,11 @@ license: cc-by-4.0
7
  KoQuality-Polyglot-5.8b is a fine-tuned version of [EleutherAI/polyglot-ko-5.8b](https://huggingface.co/EleutherAI/polyglot-ko-5.8b) on [KoQuality dataset](https://huggingface.co/datasets/DILAB-HYU/KoQuality), which is curated by proposed method (len_group=5, k=100, n=0.01, method=ppl_sampling).
8
 
9
 
10
- ### Average accuracy score of the KoBEST datasets
11
 
12
  We use [KoBEST benchmark](https://huggingface.co/datasets/skt/kobest_v1) datasets(BoolQ, COPA, HellaSwag, SentiNeg, WiC) to compare the performance of our best model and other models accuracy. Our model outperforms other models in the average accuracy score of the KoBEST datasets.
13
  <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/q4cCUCzRJa3m2f7oxI_FY.png style="max-width: 500px; width: 300%"/>
14
 
15
-
16
-
17
  | Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
18
  | --- | --- | --- | --- | --- | --- |
19
  | koquality-polyglot-5.8b | 0.5472 | 0.5979 | 0.6260 | 0.6486 | 0.6535
 
7
  KoQuality-Polyglot-5.8b is a fine-tuned version of [EleutherAI/polyglot-ko-5.8b](https://huggingface.co/EleutherAI/polyglot-ko-5.8b) on [KoQuality dataset](https://huggingface.co/datasets/DILAB-HYU/KoQuality), which is curated by proposed method (len_group=5, k=100, n=0.01, method=ppl_sampling).
8
 
9
 
10
+ ### Overall Average accuracy score of the KoBEST datasets
11
 
12
  We use [KoBEST benchmark](https://huggingface.co/datasets/skt/kobest_v1) datasets(BoolQ, COPA, HellaSwag, SentiNeg, WiC) to compare the performance of our best model and other models accuracy. Our model outperforms other models in the average accuracy score of the KoBEST datasets.
13
  <img src=https://cdn-uploads.huggingface.co/production/uploads/650fecfd247f564485f8fbcf/q4cCUCzRJa3m2f7oxI_FY.png style="max-width: 500px; width: 300%"/>
14
 
 
 
15
  | Model | 0-shot | 1-shot | 2-shot | 5-shot | 10-shot
16
  | --- | --- | --- | --- | --- | --- |
17
  | koquality-polyglot-5.8b | 0.5472 | 0.5979 | 0.6260 | 0.6486 | 0.6535