Hugging Face's logo

Kaoeiri
/
MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-8

Safetensors
mistral
Not-For-All-Audiences
Model card Files Community
Kaoeiri commited on
Commit
888cdef
·
verified ·
1 Parent(s): 1bd3f44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -95
README.md CHANGED
@@ -7,7 +7,6 @@ base_model:
7
  - unsloth/Mistral-Small-Instruct-2409
8
  - DigitalSouls/BlackSheep-DigitalSoul-22B
9
  - unsloth/Mistral-Small-Instruct-2409
10
- - Kaoeiri/Moingooistrial-22B-V1-Lora
11
  - byroneverson/Mistral-Small-Instruct-2409-abliterated
12
  - rAIfle/Acolyte-LORA
13
  - TheDrummer/Cydonia-22B-v1.2
@@ -25,11 +24,13 @@ tags:
25
  - merge
26
 
27
  ---
28
- # merge
 
29
 
30
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
31
 
32
  ## Merge Details
 
33
  ### Merge Method
34
 
35
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) as a base.
@@ -37,100 +38,39 @@ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](
37
  ### Models Merged
38
 
39
  The following models were included in the merge:
40
- * [Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B](https://huggingface.co/Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B)
41
- * [spow12/ChatWaifu_v2.0_22B](https://huggingface.co/spow12/ChatWaifu_v2.0_22B)
42
- * [allura-org/MS-Meadowlark-22B](https://huggingface.co/allura-org/MS-Meadowlark-22B)
43
- * [crestf411/MS-sunfall-v0.7.0](https://huggingface.co/crestf411/MS-sunfall-v0.7.0)
44
- * [DigitalSouls/BlackSheep-DigitalSoul-22B](https://huggingface.co/DigitalSouls/BlackSheep-DigitalSoul-22B)
45
- * [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) + [Kaoeiri/Moingooistrial-22B-V1-Lora](https://huggingface.co/Kaoeiri/Moingooistrial-22B-V1-Lora)
46
- * [byroneverson/Mistral-Small-Instruct-2409-abliterated](https://huggingface.co/byroneverson/Mistral-Small-Instruct-2409-abliterated) + [rAIfle/Acolyte-LORA](https://huggingface.co/rAIfle/Acolyte-LORA)
47
- * [TheDrummer/Cydonia-22B-v1.2](https://huggingface.co/TheDrummer/Cydonia-22B-v1.2)
48
- * [Darkknight535/MS-Moonlight-22B-v3](https://huggingface.co/Darkknight535/MS-Moonlight-22B-v3)
49
- * [TheDrummer/Cydonia-22B-v1.1](https://huggingface.co/TheDrummer/Cydonia-22B-v1.1)
50
- * [hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit](https://huggingface.co/hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit)
51
- * [InferenceIllusionist/SorcererLM-22B](https://huggingface.co/InferenceIllusionist/SorcererLM-22B)
52
- * [ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1)
53
- * [Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small](https://huggingface.co/Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small)
54
- * [TheDrummer/Cydonia-22B-v1.3](https://huggingface.co/TheDrummer/Cydonia-22B-v1.3)
55
- * [anthracite-org/magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b)
56
-
57
- ### Configuration
58
 
59
- The following YAML configuration was used to produce this model:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
 
61
- ```yaml
62
- models:
63
- - model: anthracite-org/magnum-v4-22b
64
- parameters:
65
- weight: 1.0
66
- density: 0.85
67
- - model: TheDrummer/Cydonia-22B-v1.3
68
- parameters:
69
- weight: 0.24
70
- density: 0.69
71
- - model: TheDrummer/Cydonia-22B-v1.2
72
- parameters:
73
- weight: 0.14
74
- density: 0.67
75
- - model: TheDrummer/Cydonia-22B-v1.1
76
- parameters:
77
- weight: 0.16
78
- density: 0.67
79
- - model: Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small
80
- parameters:
81
- weight: 0.26
82
- density: 0.75
83
- - model: allura-org/MS-Meadowlark-22B
84
- parameters:
85
- weight: 0.27
86
- density: 0.71
87
- - model: spow12/ChatWaifu_v2.0_22B
88
- parameters:
89
- weight: 0.27
90
- density: 0.7
91
- - model: Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B
92
- parameters:
93
- weight: 0.2
94
- density: 0.58
95
- - model: crestf411/MS-sunfall-v0.7.0
96
- parameters:
97
- weight: 0.22
98
- density: 0.71
99
- - model: byroneverson/Mistral-Small-Instruct-2409-abliterated+rAIfle/Acolyte-LORA
100
- parameters:
101
- weight: 0.24
102
- density: 0.7
103
- - model: InferenceIllusionist/SorcererLM-22B
104
- parameters:
105
- weight: 0.21
106
- density: 0.72
107
- - model: unsloth/Mistral-Small-Instruct-2409+Kaoeiri/Moingooistrial-22B-V1-Lora
108
- parameters:
109
- weight: 0.32
110
- density: 0.76
111
- - model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
112
- parameters:
113
- weight: 0.12
114
- density: 0.65
115
- - model: Darkknight535/MS-Moonlight-22B-v3
116
- parameters:
117
- weight: 0.12
118
- density: 0.62
119
- - model: hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit
120
- parameters:
121
- weight: 0.28
122
- density: 0.74
123
- - model: DigitalSouls/BlackSheep-DigitalSoul-22B
124
- parameters:
125
- weight: 0.21
126
- density: 0.69
127
 
128
- merge_method: dare_ties
129
- base_model: unsloth/Mistral-Small-Instruct-2409
130
- parameters:
131
- density: 0.85
132
- epsilon: 0.09
133
- lambda: 1.22
134
- dtype: bfloat16
135
 
136
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  - unsloth/Mistral-Small-Instruct-2409
8
  - DigitalSouls/BlackSheep-DigitalSoul-22B
9
  - unsloth/Mistral-Small-Instruct-2409
 
10
  - byroneverson/Mistral-Small-Instruct-2409-abliterated
11
  - rAIfle/Acolyte-LORA
12
  - TheDrummer/Cydonia-22B-v1.2
 
24
  - merge
25
 
26
  ---
27
+
28
+ # Merge
29
 
30
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
31
 
32
  ## Merge Details
33
+
34
  ### Merge Method
35
 
36
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) as a base.
 
38
  ### Models Merged
39
 
40
  The following models were included in the merge:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
41
 
42
+ - [Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B](https://huggingface.co/Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B)
43
+ - [spow12/ChatWaifu_v2.0_22B](https://huggingface.co/spow12/ChatWaifu_v2.0_22B)
44
+ - [allura-org/MS-Meadowlark-22B](https://huggingface.co/allura-org/MS-Meadowlark-22B)
45
+ - [crestf411/MS-sunfall-v0.7.0](https://huggingface.co/crestf411/MS-sunfall-v0.7.0)
46
+ - [DigitalSouls/BlackSheep-DigitalSoul-22B](https://huggingface.co/DigitalSouls/BlackSheep-DigitalSoul-22B)
47
+ - [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409)
48
+ - [byroneverson/Mistral-Small-Instruct-2409-abliterated](https://huggingface.co/byroneverson/Mistral-Small-Instruct-2409-abliterated) + [rAIfle/Acolyte-LORA](https://huggingface.co/rAIfle/Acolyte-LORA)
49
+ - [TheDrummer/Cydonia-22B-v1.2](https://huggingface.co/TheDrummer/Cydonia-22B-v1.2)
50
+ - [Darkknight535/MS-Moonlight-22B-v3](https://huggingface.co/Darkknight535/MS-Moonlight-22B-v3)
51
+ - [TheDrummer/Cydonia-22B-v1.1](https://huggingface.co/TheDrummer/Cydonia-22B-v1.1)
52
+ - [hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit](https://huggingface.co/hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit)
53
+ - [InferenceIllusionist/SorcererLM-22B](https://huggingface.co/InferenceIllusionist/SorcererLM-22B)
54
+ - [ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1)
55
+ - [Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small](https://huggingface.co/Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small)
56
+ - [TheDrummer/Cydonia-22B-v1.3](https://huggingface.co/TheDrummer/Cydonia-22B-v1.3)
57
+ - [anthracite-org/magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b)
58
 
59
+ ### Acknowledgments
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
 
61
+ Special thanks to the creators of the models:
 
 
 
 
 
 
62
 
63
+ - Saxo for [Linkbricks-Horizon-AI-Japanese-Superb-V1-22B](https://huggingface.co/Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V1-22B)
64
+ - spow12 for [ChatWaifu_v2.0_22B](https://huggingface.co/spow12/ChatWaifu_v2.0_22B)
65
+ - allura-org for [MS-Meadowlark-22B](https://huggingface.co/allura-org/MS-Meadowlark-22B)
66
+ - crestf411 for [MS-sunfall-v0.7.0](https://huggingface.co/crestf411/MS-sunfall-v0.7.0)
67
+ - DigitalSouls for [BlackSheep-DigitalSoul-22B](https://huggingface.co/DigitalSouls/BlackSheep-DigitalSoul-22B)
68
+ - unsloth for [Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409)
69
+ - byroneverson and rAIfle for [Mistral-Small-Instruct-2409-abliterated](https://huggingface.co/byroneverson/Mistral-Small-Instruct-2409-abliterated) and [Acolyte-LORA](https://huggingface.co/rAIfle/Acolyte-LORA)
70
+ - TheDrummer for [Cydonia-22B-v1.2](https://huggingface.co/TheDrummer/Cydonia-22B-v1.2), [Cydonia-22B-v1.1](https://huggingface.co/TheDrummer/Cydonia-22B-v1.1), and [Cydonia-22B-v1.3](https://huggingface.co/TheDrummer/Cydonia-22B-v1.3)
71
+ - Darkknight535 for [MS-Moonlight-22B-v3](https://huggingface.co/Darkknight535/MS-Moonlight-22B-v3)
72
+ - hf-100 for [Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B](https://huggingface.co/hf-100/Mistral-Small-Instruct-2409-Spellbound-StoryWriter-22B-instruct-0.4-chkpt-336-16bit)
73
+ - InferenceIllusionist for [SorcererLM-22B](https://huggingface.co/InferenceIllusionist/SorcererLM-22B)
74
+ - ArliAI for [Mistral-Small-22B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1)
75
+ - Gryphe for [Pantheon-RP-Pure-1.6.2-22b-Small](https://huggingface.co/Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small)
76
+ - anthracite-org for [magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b)