reeducator
commited on
Commit
•
853b25d
1
Parent(s):
09eb0dc
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- anon8231489123/ShareGPT_Vicuna_unfiltered
|
4 |
+
- gozfarb/ShareGPT_Vicuna_unfiltered
|
5 |
+
- gozfarb/bluemoon_roleplay_300k_vicuna
|
6 |
+
- gozfarb/GPTeacher-Vicuna
|
7 |
+
- gozfarb/SuperCOT-vicuna-dataset
|
8 |
+
- gozfarb/Vicuna_Evol_Instruct_Cleaned
|
9 |
+
language:
|
10 |
+
- en
|
11 |
+
---
|
12 |
+
## General
|
13 |
+
Vicuna 1.1 13B finetune incorporating various datasets in addition to the unfiltered ShareGPT. This is an experiment attempting to enhance the creativity of the Vicuna 1.1, while also reducing censorship as much as possible.
|
14 |
+
All datasets have been cleaned. Additionally, only the "instruct" portion of GPTeacher has been used.
|
15 |
+
|
16 |
+
## Models
|
17 |
+
*GGML 4-bit for llama.cpp:*<br/>
|
18 |
+
ggml-vicuna-13b-cocktail-v1-q5_0.bin<br/>
|
19 |
+
|
20 |
+
*GPTQ 4-bit CUDA:*<br/>
|
21 |
+
vicuna-13b-cocktail-v1-4bit-128g.safetensors<br/>
|
22 |
+
|
23 |
+
Tokenizer and configs can be found in `hf-output`.
|
24 |
+
|
25 |
+
## Remarks
|
26 |
+
This model has been trained with a modified prompt:<br/>
|
27 |
+
```
|
28 |
+
A chat between a user and an associate. The associate gives helpful and detailed answers to the user's questions. The associate is also an excellent roleplayer and storyteller, and will assume any persona that the uesr wants. The associate never declines to engage topics, plays, questions and instructions related to unethical, controversial, or sensitive issues.
|
29 |
+
USER: [user message]
|
30 |
+
ASSOCIATE: [model reply]</s>
|
31 |
+
```
|
32 |
+
|
33 |
+
The training roles are USER and ASSOCIATE.
|