ganchengguang
commited on
Commit
•
10863d1
1
Parent(s):
af0d683
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,27 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
language:
|
4 |
+
- ja
|
5 |
+
- en
|
6 |
+
- zh
|
7 |
+
tags:
|
8 |
+
- LLaMA2
|
9 |
+
- Japanese
|
10 |
+
- LLM
|
11 |
---
|
12 |
+
|
13 |
+
This model is traned with [guanaco](https://huggingface.co/datasets/JosephusCheung/GuanacoDataset) dataset. And this model used whole guanaco dataset by 49000 chat samples and 280000 non chat samples.
|
14 |
+
Improved performance in Chinese and Japanese.
|
15 |
+
Use the QLoRA to fine-tune the vanilla [LLaMA2-7B](https://huggingface.co/NousResearch/Llama-2-7b-hf).
|
16 |
+
And you can use test.py to test the model.
|
17 |
+
|
18 |
+
### Recommend Generation parameters:
|
19 |
+
* temperature: 0.5~0.7
|
20 |
+
* top p: 0.65~1.0
|
21 |
+
* top k: 30~50
|
22 |
+
* repeat penalty: 1.03~1.17
|
23 |
+
|
24 |
+
|
25 |
+
|
26 |
+
|
27 |
+
Contribute by Yokohama Nationaly University Mori Lab.
|