madslang commited on
Commit
a9ce0a4
1 Parent(s): 815adfc

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - HuggingFaceH4/zephyr-7b-beta
8
+ - danish-foundation-models/munin-7b-alpha
9
+ - timpal0l/Mistral-7B-v0.1-flashback-v2
10
+ - NbAiLab/nb-sau-7b-4k-step100k
11
+ ---
12
+
13
+ # NordicMIS-v1.0-dareties
14
+
15
+ NordicMIS-v1.0-dareties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
16
+ * [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
17
+ * [danish-foundation-models/munin-7b-alpha](https://huggingface.co/danish-foundation-models/munin-7b-alpha)
18
+ * [timpal0l/Mistral-7B-v0.1-flashback-v2](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2)
19
+ * [NbAiLab/nb-sau-7b-4k-step100k](https://huggingface.co/NbAiLab/nb-sau-7b-4k-step100k)
20
+
21
+ ## 🧩 Configuration
22
+
23
+ \```yaml
24
+ models:
25
+ - model: mistralai/Mistral-7B-v0.1
26
+ # No parameters necessary for base model
27
+ - model: HuggingFaceH4/zephyr-7b-beta
28
+ parameters:
29
+ density: 0.53
30
+ weight: 0.3
31
+ - model: danish-foundation-models/munin-7b-alpha
32
+ parameters:
33
+ density: 0.53
34
+ weight: 0.3
35
+ - model: timpal0l/Mistral-7B-v0.1-flashback-v2
36
+ parameters:
37
+ density: 0.53
38
+ weight: 0.2
39
+ - model: NbAiLab/nb-sau-7b-4k-step100k
40
+ parameters:
41
+ density: 0.53
42
+ weight: 0.2
43
+ merge_method: dare_ties
44
+ base_model: mistralai/Mistral-7B-v0.1
45
+ parameters:
46
+ int8_mask: true
47
+ dtype: bfloat16
48
+ \```