Henk717 commited on
Commit
e188915
1 Parent(s): 3f11422

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - NeverSleep/Noromaid-13B-0.4-DPO
4
+ - cgato/Thespis-13b-DPO-v0.7
5
+ - KoboldAI/LLaMA2-13B-Estopia
6
+ - Doctor-Shotgun/cat-v1.0-13b
7
+ - BlueNipples/TimeCrystal-l2-13B
8
+ - TheBloke/Llama-2-13B-fp16
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+
13
+ ---
14
+ # EstopianMaid
15
+
16
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit) by Katy.
17
+
18
+ ## Merge Details
19
+ ### Merge Method
20
+
21
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [TheBloke/Llama-2-13B-fp16](https://huggingface.co/TheBloke/Llama-2-13B-fp16) as a base.
22
+
23
+ ### Models Merged
24
+
25
+ The following models were included in the merge:
26
+ * [NeverSleep/Noromaid-13B-0.4-DPO](https://huggingface.co/NeverSleep/Noromaid-13B-0.4-DPO)
27
+ * [cgato/Thespis-13b-DPO-v0.7](https://huggingface.co/cgato/Thespis-13b-DPO-v0.7)
28
+ * [KoboldAI/LLaMA2-13B-Estopia](https://huggingface.co/KoboldAI/LLaMA2-13B-Estopia)
29
+ * [Doctor-Shotgun/cat-v1.0-13b](https://huggingface.co/Doctor-Shotgun/cat-v1.0-13b)
30
+ * [BlueNipples/TimeCrystal-l2-13B](https://huggingface.co/BlueNipples/TimeCrystal-l2-13B)
31
+
32
+ ### Configuration
33
+
34
+ The following YAML configuration was used to produce this model:
35
+
36
+ ```yaml
37
+ base_model: TheBloke/Llama-2-13B-fp16
38
+ dtype: float16
39
+ merge_method: task_arithmetic
40
+ slices:
41
+ - sources:
42
+ - layer_range: [0, 40]
43
+ model: TheBloke/Llama-2-13B-fp16
44
+ - layer_range: [0, 40]
45
+ model: BlueNipples/TimeCrystal-l2-13B
46
+ parameters:
47
+ weight: 0.75
48
+ - layer_range: [0, 40]
49
+ model: cgato/Thespis-13b-DPO-v0.7
50
+ parameters:
51
+ weight: 0.23
52
+ - layer_range: [0, 40]
53
+ model: KoboldAI/LLaMA2-13B-Estopia
54
+ parameters:
55
+ weight: 0.15
56
+ - layer_range: [0, 40]
57
+ model: NeverSleep/Noromaid-13B-0.4-DPO
58
+ parameters:
59
+ weight: 0.2
60
+ - layer_range: [0, 40]
61
+ model: Doctor-Shotgun/cat-v1.0-13b
62
+ parameters:
63
+ weight: 0.03
64
+ ```