README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - danish-foundation-models/munin-7b-alpha
  - timpal0l/Mistral-7B-v0.1-flashback-v2
  - NbAiLab/nb-sau-7b-4k-step100k

NordicMIS-v1.0-dareties

NordicMIS-v1.0-dareties is a merge of the following models using mergekit:

• danish-foundation-models/munin-7b-alpha
• timpal0l/Mistral-7B-v0.1-flashback-v2
• NbAiLab/nb-sau-7b-4k-step100k

🧩 Configuration

```yaml models:

• model: mistralai/Mistral-7B-v0.1

  No parameters necessary for base model

• model: danish-foundation-models/munin-7b-alpha parameters: density: 0.53 weight: 0.5
• model: timpal0l/Mistral-7B-v0.1-flashback-v2 parameters: density: 0.53 weight: 0.3
• model: NbAiLab/nb-sau-7b-4k-step100k parameters: density: 0.53 weight: 0.2 merge_method: dare_ties base_model: mistralai/Mistral-7B-v0.1 parameters: int8_mask: true dtype: bfloat16 ```