CoolSpring commited on
Commit
84822c0
1 Parent(s): efb8e3f

Update model card

Browse files
Files changed (1) hide show
  1. README.md +23 -5
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  language:
3
- - en
4
- license: apache-2.0
5
  tags:
6
  - text-generation-inference
7
  - transformers
@@ -9,15 +9,33 @@ tags:
9
  - gemma2
10
  - trl
11
  - sft
 
12
  base_model: unsloth/gemma-2-9b-it-bnb-4bit
13
  ---
14
 
15
- # Uploaded model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  - **Developed by:** CoolSpring
18
- - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/gemma-2-9b-it-bnb-4bit
20
 
21
  This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
  language:
3
+ - zh
4
+ license: gemma
5
  tags:
6
  - text-generation-inference
7
  - transformers
 
9
  - gemma2
10
  - trl
11
  - sft
12
+ - synthetic data
13
  base_model: unsloth/gemma-2-9b-it-bnb-4bit
14
  ---
15
 
16
+ This model is fine-tuned from [gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it). It was trained for 3 epochs on a synthetic dataset created from the book *Liaozhai Zhiyi*. The stories in the book were translated by an LLM to modern Chinese and paired with generated writing prompts.
17
+
18
+ *Liaozhai Zhiyi*, also known as *[Strange Tales from a Chinese Studio](https://en.wikipedia.org/wiki/Strange_Tales_from_a_Chinese_Studio)*, is a collection of approximately 500 stories written in the traditional Chinese Zhiguai and Chuanqi styles by Pu Songling. The aim of this fine-tuning attempt is to explore incorporating these characteristics into the storytelling capabilities of a specific model.
19
+
20
+ **Q4_K_M GGUF**: [CoolSpring/gemma-2-9b-it-liaozhai-Q4_K_M-GGUF](https://huggingface.co/CoolSpring/gemma-2-9b-it-liaozhai-Q4_K_M-GGUF)
21
+
22
+ **Prompt Template - gemma**
23
+
24
+ ```
25
+ <bos><start_of_turn>user
26
+ {input}<end_of_turn>
27
+ <start_of_turn>model
28
+ {output}<end_of_turn>
29
+ ```
30
+
31
+ Users must adhere to [Gemma Terms of Use](https://ai.google.dev/gemma/terms) when using this model.
32
+
33
+ ## Unsloth Metadata
34
 
35
  - **Developed by:** CoolSpring
36
+ - **License:** gemma
37
  - **Finetuned from model :** unsloth/gemma-2-9b-it-bnb-4bit
38
 
39
  This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
40
 
41
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)