Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: llama3
|
| 3 |
+
datasets:
|
| 4 |
+
- custom
|
| 5 |
+
- lmg-anon/VNTL-Chat
|
| 6 |
+
language:
|
| 7 |
+
- ja
|
| 8 |
+
- en
|
| 9 |
+
library_name: peft
|
| 10 |
+
base_model: rinna/llama-3-youko-8b
|
| 11 |
+
pipeline_tag: translation
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# Summary
|
| 15 |
+
|
| 16 |
+
This repository contains the merged [VNTL LLaMA3 8B 202409 qlora](https://huggingface.co/lmg-anon/vntl-llama3-8b-202409-qlora) created using a slightly modified version of the [VNTL-v3.1-1k](https://huggingface.co/datasets/lmg-anon/VNTL-v3.1-1k) dataset, concatenated with the [VNTL-Chat](https://huggingface.co/datasets/lmg-anon/VNTL-Chat) dataset. For more information about this model, please check out the [original repository](https://huggingface.co/lmg-anon/vntl-llama3-8b-qlora).
|
| 17 |
+
|
| 18 |
+
The model also includes the "chat mode", which primarily works for Japanese grammar questions. However, no further improvements have been made to it.
|
| 19 |
+
|
| 20 |
+
## Translation Prompt
|
| 21 |
+
|
| 22 |
+
This is an prompt example for translation:
|
| 23 |
+
```
|
| 24 |
+
<<METADATA>>
|
| 25 |
+
[character] Name: Uryuu Shingo (ηη ζ°εΎ) | Gender: Male | Aliases: Onii-chan (γε
γ‘γγ)
|
| 26 |
+
[character] Name: Uryuu Sakuno (ηη ζ‘δΉ) | Gender: Female
|
| 27 |
+
<<TRANSLATE>>
|
| 28 |
+
<<JAPANESE>>
|
| 29 |
+
[ζ‘δΉ]: γβ¦β¦γγγγ
|
| 30 |
+
<<ENGLISH>>
|
| 31 |
+
[Sakuno]: γ... Sorry.γ<|end_of_text|>
|
| 32 |
+
<<JAPANESE>>
|
| 33 |
+
[ζ°εΎ]: γγγγγγγθ¨γ£γ‘γγͺγγ γγ©γθΏ·εγ§γγγ£γγγζ‘δΉγ―ε―ζγγγγγγγγεΏι
γγ‘γγ£γ¦γγγ γδΏΊγ
|
| 34 |
+
<<ENGLISH>>
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
The generated translation for that prompt, with temperature 0, is:
|
| 38 |
+
```
|
| 39 |
+
[Shingo]: γNo, I'm glad you got lost. You're so cute that it made me worry a lot.γ
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
## Chat Prompt
|
| 43 |
+
|
| 44 |
+
This is an prompt example for chat:
|
| 45 |
+
```
|
| 46 |
+
<<CHAT>>
|
| 47 |
+
<<HUMAN>>
|
| 48 |
+
Hi! Can you break this down to me? Like, what is the meaning of "ζ‘δΉγ―ε―ζγγγ"?
|
| 49 |
+
"γγγγγγθ¨γ£γ‘γγͺγγ γγ©γθΏ·εγ§γγγ£γγγζ‘δΉγ―ε―ζγγγγγγγγεΏι
γγ‘γγ£γ¦γγγ γδΏΊγ"
|
| 50 |
+
<<LLM>>
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
The generated response for that prompt, with temperature 0, is:
|
| 54 |
+
```
|
| 55 |
+
Certainly! The phrase "ζ‘δΉγ―ε―ζγγγ" can be broken down as follows:
|
| 56 |
+
"ζ‘δΉ" (Sakurano) is a proper noun, likely referring to a person's name.
|
| 57 |
+
"γ―" (wa) is a particle that marks the topic or subject of the sentence.
|
| 58 |
+
"ε―ζγ" (kawaii) means "cute" or "adorable."
|
| 59 |
+
"γγ" (kara) is a conjunction that indicates a reason or cause.
|
| 60 |
+
So, the entire phrase "ζ‘δΉγ―ε―ζγγγ" translates to "Because Sakurano is cute." This suggests that the speaker finds Sakurano to be endearing or charming in some way.
|
| 61 |
+
```
|