squarelike commited on
Commit
dce3308
โ€ข
1 Parent(s): b5190c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -1
README.md CHANGED
@@ -1,3 +1,27 @@
1
  ---
2
- license: cc-by-nc-sa-4.0
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ko
4
+ tags:
5
+ - pytorch
6
+ - causal-lm
7
+ - medical
8
+ license: llama2
9
+ pipeline_tag: text-generation
10
  ---
11
+
12
+ # llama-2-ko-story-7b
13
+ llama-2-ko-story-7b๋Š” [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b)๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•œ๊ธ€ ์†Œ์„ค raw ๋ฐ์ดํ„ฐ๋ฅผ ํ•™์Šต์‹œํ‚จ ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
14
+ ## ํ•™์Šต ๋ฐ์ดํ„ฐ
15
+ llama-2-ko-story-7b๋Š” ์•ฝ 167MB์˜ ํ•œ๊ธ€ ์†Œ์„ค ๋ง๋ญ‰์น˜๋กœ ํ•™์Šต๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ฃผ์š” ๋ฐ์ดํ„ฐ์…‹์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.
16
+ | Source |Size (MB) | Link |
17
+ |----------------------------------|---------|------------------------------------------|
18
+ | ํ•œ๊ธ€ ์†Œ์„ค ๋ง๋ญ‰์น˜ | 115.0 | |
19
+ | ๊ณต์œ ๋งˆ๋‹น ํ•œ๊ตญ ๊ณ ์ „ ์†Œ์„ค ๋ง๋ญ‰์น˜ | 53.0 | https://gongu.copyright.or.kr/ |
20
+ ## ํ•™์Šต
21
+ llama-2-ko-story-7b๋Š” [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b)์—์„œ qlora๋กœ ์ถ”๊ฐ€ ํ•™์Šต๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
22
+ - lora_alpha: 16
23
+ - lora_dropout: 0.05
24
+ - lora_r: 32
25
+ - target_modules: q_proj, v_proj
26
+ - epoch: 3
27
+ - learning_rate: 3e-4