DavidAU commited on
Commit
2496d63
1 Parent(s): 67edc25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -4
README.md CHANGED
@@ -78,10 +78,14 @@ This super merge captures the attibutes of all these top models and makes them e
78
  - Emotional connections.
79
  - Prose quality
80
 
81
- This super merge is also super stable, and runs with all parameters and settings.
82
 
83
  10 versions of this model will be released, this is release #1 - "part 1".
84
 
 
 
 
 
85
  Usually I release one or two versions from the "best of the lot", however in this case all
86
  of the versions turned out so well - all with their own quirks and character - that I will be
87
  releasing all 10.
@@ -90,9 +94,7 @@ An additional series 2 and 3 will follow these 10 models as well.
90
 
91
  (examples generations below)
92
 
93
- Model may produce NSFW content :
94
-
95
- Swearing, horror, graphic horror, distressing scenes, etc etc.
96
 
97
  This model has an INTENSE action bias, with a knack for cliffhangers and surprises.
98
 
@@ -217,7 +219,45 @@ Models used:
217
 
218
  [ https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9 ]
219
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
220
 
 
221
 
222
  <h3>EXAMPLES PROMPTS and OUTPUT:</h3>
223
 
 
78
  - Emotional connections.
79
  - Prose quality
80
 
81
+ This super merge is also super stable (a hairs breath from Mistral Nemo's ppl), and runs with all parameters and settings.
82
 
83
  10 versions of this model will be released, this is release #1 - "part 1".
84
 
85
+ <B>Kiss of Madness?</B>
86
+
87
+ See the 2nd last example below, this is when the model earned its name.
88
+
89
  Usually I release one or two versions from the "best of the lot", however in this case all
90
  of the versions turned out so well - all with their own quirks and character - that I will be
91
  releasing all 10.
 
94
 
95
  (examples generations below)
96
 
97
+ Model may produce NSFW content : Swearing, horror, graphic horror, distressing scenes, etc etc.
 
 
98
 
99
  This model has an INTENSE action bias, with a knack for cliffhangers and surprises.
100
 
 
219
 
220
  [ https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9 ]
221
 
222
+ This is a four step merge (3 pass-throughs => "Fine-Tune" / "Instruct") then "mated" using "DARE-TIES".
223
+
224
+ In involves these three models:
225
+
226
+ [ https://huggingface.co/DavidAU/MN-18.5B-Celeste-V1.9-Story-Wizard-ED1-Instruct-GGUF ]
227
+
228
+ [ https://huggingface.co/DavidAU/MN-Magnum-v2.5-18.5B-kto-Story-Wizard-ED1-Instruct-GGUF ]
229
+
230
+ [ https://huggingface.co/DavidAU/MN-Rocinante-18.5B-v1.1-Story-Wizard-ED1-Instruct-GGUF ]
231
+
232
+ Combined as follows using "MERGEKIT":
233
+
234
+ <PRE>
235
+
236
+ models:
237
+ - model: E:/MN-Rocinante-18.5B-v1.1-Instruct
238
+ - model: E:/MN-magnum-v2.5-12b-kto-Instruct
239
+ parameters:
240
+ weight: .6
241
+ density: .8
242
+ - model: E:/MN-18.5B-Celeste-V1.9-Instruct
243
+ parameters:
244
+ weight: .38
245
+ density: .6
246
+ merge_method: dare_ties
247
+ tokenizer_source: union
248
+ base_model: E:/MN-Rocinante-18.5B-v1.1-Instruct
249
+ dtype: bfloat16
250
+
251
+ </PRE>
252
+
253
+ Special Notes:
254
+
255
+ Due to how DARE-TIES works, everytime you run this merge you will get a slightly different model.
256
+ This is due to "random" pruning method in "DARE-TIES".
257
+
258
+ Mistral Nemo models used here seem acutely sensitive to this process.
259
 
260
+ "tokenizer_source: union" is used so that multiple "templates" work and each fine tune uses one or two of the templates.
261
 
262
  <h3>EXAMPLES PROMPTS and OUTPUT:</h3>
263