--- base_model: - SanjiWatsuki/Silicon-Maid-7B - MTSAIR/multi_verse_model - SanjiWatsuki/Kunoichi-7B - KatyTheCutie/LemonadeRP-4.5.3 library_name: transformers tags: - mergekit - merge - mistral - text-generation --- # Smart-Lemon-Cookie-7B This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [MTSAIR/multi_verse_model](https://huggingface.co/MTSAIR/multi_verse_model) as a base. ### Models Merged The following models were included in the merge: * [SanjiWatsuki/Silicon-Maid-7B](https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B) * [SanjiWatsuki/Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B) * [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: SanjiWatsuki/Silicon-Maid-7B parameters: density: 1.0 weight: 1.0 - model: SanjiWatsuki/Kunoichi-7B parameters: density: 0.4 weight: 1.0 - model: KatyTheCutie/LemonadeRP-4.5.3 parameters: density: 0.6 weight: 1.0 merge_method: ties base_model: MTSAIR/multi_verse_model parameters: normalize: true dtype: float16 ```