Update README.md
Browse files
README.md
CHANGED
@@ -105,7 +105,7 @@ OUTPUT: κΈ°μ λ° κΈ°μ΄ κ³Όνμ μ°κ΅¬ μΈ‘λ©΄μμ λ§€μ° μ€μν©λλ€.
|
|
105 |
<br>
|
106 |
|
107 |
## **Aihub μ-ν λ²μλ°μ΄ν°μ
νκ°**
|
108 |
-
* Aihub νκ°
|
109 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/TMo05LOUhPGYNbT2ADOgi.png)
|
110 |
| model | aihub-111 | aihub-124 | aihub-125 | aihub-126 | aihub-563 | aihub-71265 | aihub-71266 | aihub-71382 | average |
|
111 |
|:-----------------|------------:|------------:|------------:|------------:|------------:|--------------:|--------------:|--------------:|----------:|
|
@@ -120,7 +120,7 @@ OUTPUT: κΈ°μ λ° κΈ°μ΄ κ³Όνμ μ°κ΅¬ μΈ‘λ©΄μμ λ§€μ° μ€μν©λλ€.
|
|
120 |
| our-instrucTrans | 24.89 | 47.00 | 22.78 | 21.78 | 24.27 | 27.98 | 31.31 | 15.42 |**26.92** |
|
121 |
## **FLoRes μ-ν λ²μλ°μ΄ν°μ
νκ°**
|
122 |
[FloRes](https://huggingface.co/datasets/facebook/flores)λ νμ΄μ€λΆμμ 곡κ°ν μμ΄μ μ μ 리μμ€μ μΈμ΄ 200κ°μ λν΄μ λ³λ ¬λ‘ ꡬμ±ν λ²μ λ²€μΉλ§ν¬ λ°μ΄ν°μ
μ
λλ€.
|
123 |
-
traintogpb/aihub-flores-koen-integrated-sparta-30kλ₯Ό νμ©νμ¬ νκ°λ₯Ό μ§ννμμ΅λλ€. (νλ¬Έμ₯ ꡬμ±)
|
124 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/ZDeA-7e-0xfXaGOmyS9zs.png)
|
125 |
| model | flores-dev | flores-devtest | average |
|
126 |
|:-----------------|-------------:|-----------------:|----------:|
|
@@ -134,9 +134,9 @@ traintogpb/aihub-flores-koen-integrated-sparta-30kλ₯Ό νμ©νμ¬ νκ°λ₯Ό μ§
|
|
134 |
| our-sharegpt | 14.71 | 16.69 | 15.70 |
|
135 |
| our-instrucTrans | 14.49 | 17.69 | **16.09** |
|
136 |
## **iwslt-2023**
|
137 |
-
λμΌν μμ΄λ¬Έμ₯μ κ°κ° λ°λ§, μ‘΄λλ§μ νκ΅μ΄λ‘ νκ°λ°μ΄ν°μ
μ΄ κ΅¬μ±λμ΄ μμ΅λλ€. λͺ¨λΈμ μ‘΄λ/λ°λ§ κ²½ν₯μ μλμ μΌλ‘ νμΈν μ μμ΅λλ€. (νλ¬Έμ₯ ꡬμ±)
|
138 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/UJvuCnbjWokBWQNhD4L63.png)
|
139 |
-
| model |
|
140 |
|:-----------------|---------------------:|------------------:|----------:|
|
141 |
| EEVE-10.8b-it | 4.62 | 3.79 | 4.20 |
|
142 |
| KULLM3 | 5.94 | 5.24 | 5.59 |
|
@@ -148,7 +148,7 @@ traintogpb/aihub-flores-koen-integrated-sparta-30kλ₯Ό νμ©νμ¬ νκ°λ₯Ό μ§
|
|
148 |
| our-sharegpt | 7.83 | 6.35 | 7.09 |
|
149 |
| our-instrucTrans | 8.63 | 6.97 | 7.80 |
|
150 |
## **ko_news_eval40**
|
151 |
-
24λ
5μ λ΄μ€λ₯Ό κ° μΉ΄ν
κ³ λ¦¬(4) λ³ 10κ°μ© κΈ°μ¬ λ΄ λ¬Έλ¨ μΌλΆλ₯Ό μμ§νκ³ , GPT4λ‘ λ²μνμ¬ κ΅¬μ±νμμ΅λλ€.
|
152 |
μμ΄λ₯Ό μΌμλ΄μ€μ μ¬μ©λλ νκ΅μ΄λ‘ μ λ²μνλμ§λ₯Ό νκ°ν©λλ€. (λ¬Έλ¨ κ΅¬μ±)
|
153 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/OaE5z_yQT9sIIz0zsn644.png)
|
154 |
| model | IT/κ³Όν | κ²½μ | μ¬ν | μ€νΌλμΈ | average |
|
|
|
105 |
<br>
|
106 |
|
107 |
## **Aihub μ-ν λ²μλ°μ΄ν°μ
νκ°**
|
108 |
+
* [Aihub νκ° λ°μ΄ν°μ
]](https://huggingface.co/datasets/traintogpb/aihub-flores-koen-integrated-sparta-30k)μ λͺ¨λΈλ€μ΄ νμ΅λ°μ΄ν°μ
μ ν¬ν¨λμμ μ μμ΅λλ€. μΉ΄ν
κ³ λ¦¬λ³ μ±λ₯μ νμΈνλ μ©λλ‘λ§ μ°Έκ³ ν΄μ£ΌμΈμ. [[μΉ΄ν
κ³ λ¦¬ μ€λͺ
λ§ν¬]](https://huggingface.co/datasets/traintogpb/aihub-koen-translation-integrated-tiny-100k)
|
109 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/TMo05LOUhPGYNbT2ADOgi.png)
|
110 |
| model | aihub-111 | aihub-124 | aihub-125 | aihub-126 | aihub-563 | aihub-71265 | aihub-71266 | aihub-71382 | average |
|
111 |
|:-----------------|------------:|------------:|------------:|------------:|------------:|--------------:|--------------:|--------------:|----------:|
|
|
|
120 |
| our-instrucTrans | 24.89 | 47.00 | 22.78 | 21.78 | 24.27 | 27.98 | 31.31 | 15.42 |**26.92** |
|
121 |
## **FLoRes μ-ν λ²μλ°μ΄ν°μ
νκ°**
|
122 |
[FloRes](https://huggingface.co/datasets/facebook/flores)λ νμ΄μ€λΆμμ 곡κ°ν μμ΄μ μ μ 리μμ€μ μΈμ΄ 200κ°μ λν΄μ λ³λ ¬λ‘ ꡬμ±ν λ²μ λ²€μΉλ§ν¬ λ°μ΄ν°μ
μ
λλ€.
|
123 |
+
[traintogpb/aihub-flores-koen-integrated-sparta-30k](https://huggingface.co/datasets/traintogpb/aihub-flores-koen-integrated-sparta-30k)λ₯Ό νμ©νμ¬ νκ°λ₯Ό μ§ννμμ΅λλ€. (νλ¬Έμ₯ ꡬμ±)
|
124 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/ZDeA-7e-0xfXaGOmyS9zs.png)
|
125 |
| model | flores-dev | flores-devtest | average |
|
126 |
|:-----------------|-------------:|-----------------:|----------:|
|
|
|
134 |
| our-sharegpt | 14.71 | 16.69 | 15.70 |
|
135 |
| our-instrucTrans | 14.49 | 17.69 | **16.09** |
|
136 |
## **iwslt-2023**
|
137 |
+
[iwslt-2023 λ°μ΄ν°μ
](https://huggingface.co/datasets/shreevigneshs/iwslt-2023-en-ko-train-val-split-0.1)μ λμΌν μμ΄λ¬Έμ₯μ κ°κ° λ°λ§, μ‘΄λλ§μ νκ΅μ΄λ‘ νκ°λ°μ΄ν°μ
μ΄ κ΅¬μ±λμ΄ μμ΅λλ€. λͺ¨λΈμ μ‘΄λ/λ°λ§ κ²½ν₯μ μλμ μΌλ‘ νμΈν μ μμ΅λλ€. (νλ¬Έμ₯ ꡬμ±)
|
138 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/UJvuCnbjWokBWQNhD4L63.png)
|
139 |
+
| model | iwslt_zondae | iwslt_banmal | average |
|
140 |
|:-----------------|---------------------:|------------------:|----------:|
|
141 |
| EEVE-10.8b-it | 4.62 | 3.79 | 4.20 |
|
142 |
| KULLM3 | 5.94 | 5.24 | 5.59 |
|
|
|
148 |
| our-sharegpt | 7.83 | 6.35 | 7.09 |
|
149 |
| our-instrucTrans | 8.63 | 6.97 | 7.80 |
|
150 |
## **ko_news_eval40**
|
151 |
+
[ko_news_eval40 λ°μ΄ν°μ
](https://huggingface.co/datasets/nayohan/ko_news_eval40)μ νμ΅λμ§ μμμ μλ‘μ΄ λ°μ΄ν°μ
μ νκ°νκ³ μ 24λ
5μ λ΄μ€λ₯Ό κ° μΉ΄ν
κ³ λ¦¬(4) λ³ 10κ°μ© κΈ°μ¬ λ΄ λ¬Έλ¨ μΌλΆλ₯Ό μμ§νκ³ , GPT4λ‘ λ²μνμ¬ κ΅¬μ±νμμ΅λλ€.
|
152 |
μμ΄λ₯Ό μΌμλ΄μ€μ μ¬μ©λλ νκ΅μ΄λ‘ μ λ²μνλμ§λ₯Ό νκ°ν©λλ€. (λ¬Έλ¨ κ΅¬μ±)
|
153 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/OaE5z_yQT9sIIz0zsn644.png)
|
154 |
| model | IT/κ³Όν | κ²½μ | μ¬ν | μ€νΌλμΈ | average |
|