--- base_model: - TheDrummer/Cydonia-22B-v1.1 - TroyDoesAI/BlackSheep-MermaidMistral-22B - DigitalSouls/BlackSheep-DigitalSoul-22B - Kaoeiri/MS_fujin-2409-22B - Kaoeiri/MS-Inky-2409-22B - crestf411/MS-sunfall-v0.7.0 - unsloth/Mistral-Small-Instruct-2409 - Kaoeiri/MS_Moingooistral-2409-22B - Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small - InferenceIllusionist/SorcererLM-22B - hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit - Envoid/Mistral-Small-NovusKyver - Kaoeiri/MS_dampf-2409-22B - Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6 - Darkknight535/MS-Moonlight-22B-v3 - Kaoeiri/MS_a-coolyte-2409-22B - ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1 library_name: transformers tags: - mergekit - merge - not-for-all-audiences license: cc-by-nc-nd-4.0 --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) as a base. ### Models Merged The following models were included in the merge: * [TheDrummer/Cydonia-22B-v1.1](https://huggingface.co/TheDrummer/Cydonia-22B-v1.1) * [TroyDoesAI/BlackSheep-MermaidMistral-22B](https://huggingface.co/TroyDoesAI/BlackSheep-MermaidMistral-22B) * [DigitalSouls/BlackSheep-DigitalSoul-22B](https://huggingface.co/DigitalSouls/BlackSheep-DigitalSoul-22B) * [Kaoeiri/MS_fujin-2409-22B](https://huggingface.co/Kaoeiri/MS_fujin-2409-22B) * [Kaoeiri/MS-Inky-2409-22B](https://huggingface.co/Kaoeiri/MS-Inky-2409-22B) * [crestf411/MS-sunfall-v0.7.0](https://huggingface.co/crestf411/MS-sunfall-v0.7.0) * [Kaoeiri/MS_Moingooistral-2409-22B](https://huggingface.co/Kaoeiri/MS_Moingooistral-2409-22B) * [Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small](https://huggingface.co/Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small) * [InferenceIllusionist/SorcererLM-22B](https://huggingface.co/InferenceIllusionist/SorcererLM-22B) * [hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit](https://huggingface.co/hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit) * [Envoid/Mistral-Small-NovusKyver](https://huggingface.co/Envoid/Mistral-Small-NovusKyver) * [Kaoeiri/MS_dampf-2409-22B](https://huggingface.co/Kaoeiri/MS_dampf-2409-22B) * [Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6](https://huggingface.co/Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6) * [Darkknight535/MS-Moonlight-22B-v3](https://huggingface.co/Darkknight535/MS-Moonlight-22B-v3) * [Kaoeiri/MS_a-coolyte-2409-22B](https://huggingface.co/Kaoeiri/MS_a-coolyte-2409-22B) * [ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: # Primary Fiction Core (Rebalanced for character focus) - model: Kaoeiri/MS_Moingooistral-2409-22B # Monster fiction core parameters: weight: 0.22 # Reduced from 0.28 density: 0.72 # Adjusted for balance - model: Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6 # Main writing engine parameters: weight: 0.72 # Increased to compensate for other reductions density: 0.78 # Increased for better detail # World Building & Character Focus (Enhanced) - model: Kaoeiri/MS-Inky-2409-22B # World dynamics with character focus parameters: weight: 0.42 # Increased for stronger character-world integration density: 0.85 # Increased for richer character detail - model: Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small # Character interaction specialist parameters: weight: 0.48 # Increased for deeper character development density: 0.82 # Enhanced for personality detail # Combat & Magic (Rebalanced) - model: DigitalSouls/BlackSheep-DigitalSoul-22B # Combat parameters: weight: 0.16 # Significantly reduced density: 0.70 # Maintained for quality - model: InferenceIllusionist/SorcererLM-22B # Magical elements parameters: weight: 0.35 # Increased to maintain magical detail density: 0.78 # Enhanced for better integration # Story Elements (Adjusted) - model: TheDrummer/Cydonia-22B-v1.1 parameters: weight: 0.22 # Slight increase for narrative depth density: 0.72 - model: crestf411/MS-sunfall-v0.7.0 # Writing enhancement parameters: weight: 0.22 # Increased for better writing quality density: 0.75 - model: Kaoeiri/MS_a-coolyte-2409-22B # Character style content parameters: weight: 0.25 # Increased for better character elements density: 0.76 # Ideas Generation - model: Kaoeiri/MS_fujin-2409-22B parameters: weight: 0.07 # Significantly reduced density: 0.62 - model: Kaoeiri/MS_dampf-2409-22B parameters: weight: 0.12 density: 0.68 # Story Enhancement & Character Detail - model: hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit parameters: weight: 0.28 # Increased for better story-character integration density: 0.75 - model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1 # Character interaction parameters: weight: 0.18 # Increased for better character dynamics density: 0.68 - model: Darkknight535/MS-Moonlight-22B-v3 # Character detail specialist parameters: weight: 0.22 # Increased for deeper character profiles density: 0.72 - model: Envoid/Mistral-Small-NovusKyver # Maintained core functionality parameters: weight: 0.12 # Reduced to minimize instruction avoidance density: 0.65 # Adjusted down to reduce negative behaviors - model: TroyDoesAI/BlackSheep-MermaidMistral-22B # Character moments parameters: weight: 0.25 # Slight increase for character interaction density: 0.74 # Increased for better detail merge_method: dare_ties base_model: unsloth/Mistral-Small-Instruct-2409 parameters: density: 0.98 # Increased for maximum character detail epsilon: 0.047 # Reduced for better consistency lambda: 1.58 # Increased for creative elements while maintaining coherence dtype: bfloat16 tokenizer_source: union ```