Moraliane commited on
Commit
071773a
·
verified ·
1 Parent(s): 8a2150c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +89 -56
README.md CHANGED
@@ -1,56 +1,89 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Testmrg
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the della_linear merge method using E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
22
- * E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
23
- * E:\Programs\TextGen\text-generation-webui\models\TheDrummer_Rocinante-12B-v1.1
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- models:
31
- - model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
32
- parameters:
33
- weight: 0.5 # Основной акцент на русском языке
34
- density: 0.4
35
- - model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
36
- parameters:
37
- weight: 0.2 # РП модель, чуть меньший вес из-за ориентации на английский
38
- density: 0.4
39
- - model: E:\Programs\TextGen\text-generation-webui\models\TheDrummer_Rocinante-12B-v1.1
40
- parameters:
41
- weight: 0.2 # Увеличенный вес для усиления РП аспектов
42
- density: 0.5 # Повышенная плотность для более сильного влияния
43
- - model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
44
- parameters:
45
- weight: 0.25 # Русскоязычная поддержка и баланс
46
- density: 0.4
47
-
48
- merge_method: della_linear
49
- base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
50
- parameters:
51
- epsilon: 0.05
52
- lambda: 1
53
- dtype: float16
54
- tokenizer_source: base
55
-
56
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - IlyaGusev/saiga_nemo_12b
4
+ - Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
5
+ - TheDrummer/Rocinante-12B-v1.1
6
+ - MarinaraSpaghetti/NemoMix-Unleashed-12B
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+ - rp
12
+ - russian
13
+ - role-play
14
+ language:
15
+ - ru
16
+ - en
17
+ ---
18
+ ![NekoMix-12B](./remix.webp)
19
+ # GGUF: thx team mradermacher
20
+ Soon...
21
+
22
+ # GGUF imatrix
23
+ Soon...
24
+
25
+ # Presets
26
+ The given presets are quite suitable for this model. https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved
27
+
28
+ # Sampler
29
+
30
+
31
+ ```
32
+ Temp - 0,7 - 1,25 ~
33
+ TopA - 0,1
34
+ DRY - 0,8 1,75 2 0
35
+ I recommend trying the stock presets from SillyTavern, such as simple-1.
36
+ ```
37
+
38
+
39
+
40
+
41
+
42
+ # Testmrg
43
+
44
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
45
+
46
+ ## Merge Details
47
+ ### Merge Method
48
+
49
+ This model was merged using the della_linear merge method using E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b as a base.
50
+
51
+ ### Models Merged
52
+
53
+ The following models were included in the merge:
54
+ * E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
55
+ * E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
56
+ * E:\Programs\TextGen\text-generation-webui\models\TheDrummer_Rocinante-12B-v1.1
57
+
58
+ ### Configuration
59
+
60
+ The following YAML configuration was used to produce this model:
61
+
62
+ ```yaml
63
+ models:
64
+ - model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
65
+ parameters:
66
+ weight: 0.5 # Основной акцент на русском языке
67
+ density: 0.4
68
+ - model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
69
+ parameters:
70
+ weight: 0.2 # РП модель, чуть меньший вес из-за ориентации на английский
71
+ density: 0.4
72
+ - model: E:\Programs\TextGen\text-generation-webui\models\TheDrummer_Rocinante-12B-v1.1
73
+ parameters:
74
+ weight: 0.2 # Увеличенный вес для усиления РП аспектов
75
+ density: 0.5 # Повышенная плотность для более сильного влияния
76
+ - model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
77
+ parameters:
78
+ weight: 0.25 # Русскоязычная поддержка и баланс
79
+ density: 0.4
80
+
81
+ merge_method: della_linear
82
+ base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
83
+ parameters:
84
+ epsilon: 0.05
85
+ lambda: 1
86
+ dtype: float16
87
+ tokenizer_source: base
88
+
89
+ ```