Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- Norquinal/claude_multiround_chat_1k
|
| 4 |
+
---
|
| 5 |
+
This is the [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) model fine-tuned using QLoRA (4-bit precision) on my [claude_multiround_chat_1k](https://huggingface.co/datasets/Norquinal/claude_multiround_chat_1k) dataset, which is a randomized subset of ~1000 samples from my [claude_multiround_chat_30k](https://huggingface.co/datasets/Norquinal/claude_multiround_chat_30k) dataset.
|
| 6 |
+
|
| 7 |
+
Do not take this model very seriously, it is probably not very good. I haven't a clue of what I'm doing. I just thought it was a fun thing to make.
|
| 8 |
+
|
| 9 |
+
## Prompt Format
|
| 10 |
+
The model was finetuned with the Vicuna 1.1 prompt format:
|
| 11 |
+
```
|
| 12 |
+
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
|
| 13 |
+
|
| 14 |
+
USER: {instruction}
|
| 15 |
+
ASSISTANT:
|
| 16 |
+
```
|
| 17 |
+
|
| 18 |
+
## Use in Text Generation Web UI
|
| 19 |
+
Qwen-7B necessitates the use of the `--trust-remote-code` flag as well as installing several python libraries, including `tiktoken`, `einops`, and `transformers_stream_generator`. Once you have those installed you should be good to go. Qwen-7B does [NOT have any special tokens](https://github.com/QwenLM/Qwen-7B/blob/main/tokenization_note.md), but Text Generation Web UI neccistates that I added some anyway.
|
| 20 |
+
|
| 21 |
+
## Example Usage
|
| 22 |
+
>USER: First, give a brief overview of Chinese cuisine, including its regional diversity. next, describe the importance of the five flavors in Chinese cooking. Then, mention three popular Chinese dishes and their main ingredients. After that, provide a popular Chinese cooking technique and an example of a dish prepared using that technique. Finally, discuss the role of tea in traditional Chinese culture.
|
| 23 |
+
|
| 24 |
+
>ASSISTANT: Chinese cuisine is known for its wide variety across different regions within China. Some of the major cuisines include Cantonese, Sichuan, Shandong, Jiangsu and Zhejiang styles which vary significantly based on geography, climate and available ingredients.
|
| 25 |
+
>
|
| 26 |
+
>The "Five Flavors" - sweet, sour, bitter, salty and spicy - are considered essential elements of Chinese cooking. They balance each other out and bring depth of flavor to dishes.
|
| 27 |
+
>
|
| 28 |
+
>Three popular Chinese dishes with main ingredients include:
|
| 29 |
+
>
|
| 30 |
+
>- Kung Pao Chicken (Sichuan style) - diced chicken meat marinated in soy sauce, ginger and garlic then stir-fried with chili peppers, peanuts and vegetables
|
| 31 |
+
>
|
| 32 |
+
>- Fried Rice Noodles (Jiangsu style) - egg noodles fried with pork, shrimp and vegetables in a savory sauce
|
| 33 |
+
>
|
| 34 |
+
>- Dumplings filled with minced pork and mixed greens
|
| 35 |
+
>
|
| 36 |
+
>Stir frying is a common Chinese cooking technique where foods like meats or vegetables are quickly cooked over high heat in oil until just done. This retains nutrients while producing crispy textures and deep flavors.
|
| 37 |
+
>
|
| 38 |
+
>Tea has been an integral part of Chinese culture since ancient times. It symbolizes hospitality, friendship and respect among guests. In traditional settings, tea is often served multiple times throughout meals as a sign of warmth and generosity from hosts.
|