jujbob commited on
Commit
9008427
โ€ข
1 Parent(s): da41283

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -53,6 +53,22 @@ The Bllossom language model is a Korean-English bilingual language model based o
53
  * [2023/07] We released Bllossom v0.7, based on polyglot-ko.
54
 
55
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
  ## Example code
57
  ### Install Dependencies
58
  ```bash
 
53
  * [2023/07] We released Bllossom v0.7, based on polyglot-ko.
54
 
55
 
56
+ ```bash
57
+ ์ €ํฌ ์„œ์šธ๊ณผ๊ธฐ๋Œ€ MLP์—ฐ๊ตฌ์‹ค์—์„œ ํ•œ๊ตญ์–ด-์˜์–ด ์ด์ค‘ ์–ธ์–ด๋ชจ๋ธ์ธ Bllossom์„ ๊ณต๊ฐœํ–ˆ์Šต๋‹ˆ๋‹ค!
58
+ - LLama3-8B ๊ธฐ๋ฐ˜์˜ ๊ฒฝ๋Ÿ‰ํ™”๋œ ์‚ฌ์ด์ฆˆ
59
+ - ํ•œ๊ตญ์–ด-์˜์–ด ์ง€์‹์—ฐ๊ฒฐ์„ ํ†ตํ•œ ํ•œ๊ตญ์–ด ์ง€์‹ ๊ฐ•ํ™”
60
+ - ํ•œ๊ตญ์–ด ์–ดํœ˜์ถ”๊ฐ€
61
+ - ํ•œ๊ตญ์–ด ๋ฌธํ™”, ์–ธ์–ด๋ฅผ ๊ณ ๋ คํ•œ ์ž์ฒด์ œ์ž‘ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ๋ฏธ์„ธ์กฐ์ •
62
+ - ๊ฐ•ํ™”ํ•™์Šต (DPO)
63
+ - ์‹œ๊ฐ-์–ธ์–ด ๋ชจ๋ธํ™•์žฅ
64
+
65
+ 1. Bllossom์€ ์„œ์šธ๊ณผ๊ธฐ๋Œ€, ํ…Œ๋””์ธ, ์—ฐ์„ธ๋Œ€ ์–ธ์–ด์ž์› ์—ฐ๊ตฌ์‹ค์˜ ์–ธ์–ดํ•™์ž์™€ ํ˜‘์—…ํ•ด ๋งŒ๋“  ์‹ค์šฉ์ฃผ์˜๊ธฐ๋ฐ˜ ์–ธ์–ด๋ชจ๋ธ์ž…๋‹ˆ๋‹ค! ์•ž์œผ๋กœ ์ง€์†์ ์ธ ์—…๋ฐ์ดํŠธ๋ฅผ ํ†ตํ•ด ๊ด€๋ฆฌํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค ๋งŽ์ด ํ™œ์šฉํ•ด์ฃผ์„ธ์š” ๐Ÿ™‚
66
+ 2. Bllossom70B๋ชจ๋ธ, ์–ดํœ˜ํ™•์žฅ๋ชจ๋ธ, ์‹œ๊ฐ-์–ธ์–ด๋ชจ๋ธ์€ ์ถ”ํ›„ ๊ณต๊ฐœํ•  ์˜ˆ์ •์ž…๋‹ˆ๋‹ค. (๊ถ๊ธˆํ•˜์‹ ๋ถ„์€ ๊ฐœ๋ณ„ ์—ฐ๋ฝ์ฃผ์„ธ์š”, GPU๋งŒ ์ง€์›ํ•ด์ฃผ์‹œ๋ฉด ๋ฌด๋ฃŒ๋กœ ๋“œ๋ฆฝ๋‹ˆ๋‹ค!)
67
+ 3. Bllossom์€ NAACL2024, LREC-COLING2024 (๊ตฌ๋‘) ๋ฐœํ‘œ๋กœ ์ฑ„ํƒ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
68
+ 4. ์ข‹์€ ์–ธ์–ด๋ชจ๋ธ ๊ณ„์† ์—…๋ฐ์ดํŠธ ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค!! ํ•œ๊ตญ์–ด ๊ฐ•ํ™”๋ฅผ์œ„ํ•ด ๊ณต๋™ ์—ฐ๊ตฌํ•˜์‹ค๋ถ„ ์–ธ์ œ๋“  ํ™˜์˜ํ•ฉ๋‹ˆ๋‹ค!!
69
+ ```
70
+
71
+
72
  ## Example code
73
  ### Install Dependencies
74
  ```bash