--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - PocketDoc/Dans-AdventurousWinds-Mk2-7b - mistralai/Mistral-7B-v0.1 --- # without_Adventurous_apart_from_Mistral-7B_task_arithmetic without_Adventurous_apart_from_Mistral-7B_task_arithmetic is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [PocketDoc/Dans-AdventurousWinds-Mk2-7b](https://huggingface.co/PocketDoc/Dans-AdventurousWinds-Mk2-7b) * [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) ## 🧩 Configuration ```yaml models: - model: PocketDoc/Dans-AdventurousWinds-Mk2-7b parameters: weight: 1 density: 0.9 gamma: 0.01 - model: mistralai/Mistral-7B-v0.1 parameters: weight: 1 density: 0.9 gamma: 0.01 merge_method: task_arithmetic base_model: PocketDoc/Dans-AdventurousWinds-Mk2-7b parameters: normalize: true int8_mask: true dtype: bfloat16 ```