Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,47 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
datasets:
|
4 |
+
- Calvin-Xu/FLFL-Aozora-Speech-Train
|
5 |
+
language:
|
6 |
+
- ja
|
7 |
+
metrics:
|
8 |
+
- sacrebleu
|
9 |
+
pipeline_tag: text2text-generation
|
10 |
+
---
|
11 |
+
|
12 |
+
### Finetuned from
|
13 |
+
[stockmark/gpt-neox-japanese-1.4b](https://huggingface.co/stockmark/gpt-neox-japanese-1.4b)
|
14 |
+
|
15 |
+
### Training Dataset
|
16 |
+
|
17 |
+
Trained for slightly over one epoch on [Calvin-Xu/FLFL-Aozora-Speech-Train](https://huggingface.co/datasets/Calvin-Xu/FLFL-Aozora-Speech-Train)
|
18 |
+
|
19 |
+
### Training Settings
|
20 |
+
|
21 |
+
HuggingFace Trainer, PEFT (r=64, alpha=128)
|
22 |
+
|
23 |
+
Control tokens added: `[INST]`, ` [/INST]`, `<ruby>`, `</ruby>`, `<rt>`, `</rt>`
|
24 |
+
|
25 |
+
### Output Examples
|
26 |
+
|
27 |
+
```
|
28 |
+
[INST] ๆฌกใฎๆใซๆญฃ็ขบใซๆฏใไปฎๅใไปใใฆใใ ใใ
|
29 |
+
|
30 |
+
ๅฝๅขใฎ้ทใใใณใใซใๆใใใจ้ชๅฝใงใใฃใ
|
31 |
+
|
32 |
+
[/INST]
|
33 |
+
|
34 |
+
<ruby>ๅฝๅข<rt>ใใซใใใ</rt></ruby>ใฎ<ruby>้ท<rt>ใชใ</rt></ruby>ใใใณใใซใ<ruby>ๆ<rt>ใฌ</rt></ruby>ใใใจ<ruby>้ชๅฝ<rt>ใใใใซ</rt></ruby>ใงใใฃใ<|endoftext|>
|
35 |
+
```
|
36 |
+
|
37 |
+
- <ruby>้ฐค<rt>ใถใ</rt></ruby>ใฎ<ruby>็
ง<rt>ใฆ</rt></ruby>ใ<ruby>็ผ<rt>ใ</rt></ruby>ใใ<ruby>ๅ
ซๅฎ่<rt>ใฏใฃใฝใใใ</rt></ruby>ใใใณใใผใฐใ<|endoftext|>
|
38 |
+
|
39 |
+
- <ruby>ไธป่<rt>ใใ
ใใ</rt></ruby><ruby>้ข้ฃ<rt>ใใใใ</rt></ruby>ใฏใ<ruby>่ฆไบ<rt>ใฟใใจ</rt></ruby>ใชใพใงใฎ<ruby>ๅๆด<rt>ใใใ</rt></ruby><ruby>ไธญ<rt>ใกใ
ใ</rt></ruby><ruby>ๆ่กท<rt>ใใฃใกใ
ใ</rt></ruby>ใ<|endoftext|>
|
40 |
+
|
41 |
+
- <ruby>ๅฅ<rt>ในใค</rt></ruby>ใฎ<ruby>่
<rt>ใใฎ</rt></ruby>ใฎ<ruby>็ฎ<rt>ใ</rt></ruby>ใ<ruby>้<rt>ใคใ</rt></ruby>ใใฆ<ruby>ๆญดๅฒ<rt>ใใใ</rt></ruby>ใ<ruby>ๅฃ้่ฆ<rt>ใใใพใฟ</rt></ruby>ใใใใจใฏใ<ruby>ๆณๅ<rt>ใใใใ</rt></ruby>ใ<ruby>่ถ
<rt>ใ</rt></ruby>ใใ<ruby>ไฝ้จ<rt>ใใใใ</rt></ruby>ใซ<ruby>้<rt>ใกใ</rt></ruby>ใใชใ!<|endoftext|>
|
42 |
+
|
43 |
+
- <ruby>ๆญข<rt>ใจ</rt></ruby>ใใใชใใใใฎ<ruby>ๅคงๆฌ<rt>ใใใใจ</rt></ruby>ใ<ruby>ๆ น็ตถ<rt>ใญใ </rt></ruby>ใใใซใใชใใจ<ruby>ๅนๆ<rt>ใใใ</rt></ruby>ใใชใใ<|endoftext|>
|
44 |
+
|
45 |
+
- <ruby>ไธไบบๆฐ<rt>ใตใซใใ</rt></ruby><ruby>้ๆ<rt>ใใถ</rt></ruby>ใงใใ<ruby>ไปฅไธ<rt>ใใใใ</rt></ruby><ruby>ไพกๅค<rt>ใใก</rt></ruby>ใ<ruby>ไธ<rt>ใ</rt></ruby>ใใใใใชใใใใใปใจใใฉ<ruby>ๅบๅค<rt>ใใใญ</rt></ruby>ใ <|endoftext|>
|
46 |
+
|
47 |
+
- <ruby>ๆ้<rt>ใใใ</rt></ruby>ใฎ<ruby>ๆพฑ<rt>ใใ</rt></ruby>ใฎ<ruby>ไธญ<rt>ใชใ</rt></ruby>ใซ<ruby>ๆฒๆฎฟ<rt>ใกใใใ</rt></ruby>ใใฆใใใใใ ใ<|endoftext|>
|