ganchengguang commited on
Commit
10863d1
1 Parent(s): af0d683

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -1,3 +1,27 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ language:
4
+ - ja
5
+ - en
6
+ - zh
7
+ tags:
8
+ - LLaMA2
9
+ - Japanese
10
+ - LLM
11
  ---
12
+
13
+ This model is traned with [guanaco](https://huggingface.co/datasets/JosephusCheung/GuanacoDataset) dataset. And this model used whole guanaco dataset by 49000 chat samples and 280000 non chat samples.
14
+ Improved performance in Chinese and Japanese.
15
+ Use the QLoRA to fine-tune the vanilla [LLaMA2-7B](https://huggingface.co/NousResearch/Llama-2-7b-hf).
16
+ And you can use test.py to test the model.
17
+
18
+ ### Recommend Generation parameters:
19
+ * temperature: 0.5~0.7
20
+ * top p: 0.65~1.0
21
+ * top k: 30~50
22
+ * repeat penalty: 1.03~1.17
23
+
24
+
25
+
26
+
27
+ Contribute by Yokohama Nationaly University Mori Lab.