--- base_model: - KatyTheCutie/EstopianMaid-13B - Undi95/MLewdBoros-L2-13B library_name: transformers tags: - mergekit - merge --- # EstopianMaid-Orca2-MlewdBoros This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [KatyTheCutie/EstopianMaid-13B](https://huggingface.co/KatyTheCutie/EstopianMaid-13B) as a base. ### Models Merged The following models were included in the merge: * E:\Machine Learning\Models\Orca2-Flat-BF16 * [Undi95/MLewdBoros-L2-13B](https://huggingface.co/Undi95/MLewdBoros-L2-13B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: KatyTheCutie/EstopianMaid-13B - model: E:\Machine Learning\Models\Orca2-Flat-BF16 parameters: weight: 1.0 density: 0.4 - model: Undi95/MLewdBoros-L2-13B parameters: weight: 1.0 density: 0.2 merge_method: ties base_model: KatyTheCutie/EstopianMaid-13B dtype: bfloat16 ```