vishnukv commited on
Commit
a6f07d4
1 Parent(s): f0e0c9f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -29
README.md CHANGED
@@ -7,13 +7,12 @@ library_name: transformers
7
  tags:
8
  - mergekit
9
  - merge
10
-
11
  ---
12
  # merge
13
 
14
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
 
16
- ## Merge Details
17
  ### Merge Method
18
 
19
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b](https://huggingface.co/uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b) as a base.
@@ -24,30 +23,3 @@ The following models were included in the merge:
24
  * [PetroGPT/WestSeverus-7B-DPO](https://huggingface.co/PetroGPT/WestSeverus-7B-DPO)
25
  * [vishnukv/WestSeverusJaskier](https://huggingface.co/vishnukv/WestSeverusJaskier)
26
 
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
-
33
- models:
34
- - model: uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b
35
- # No parameters necessary for base model
36
- - model: vishnukv/WestSeverusJaskier
37
- parameters:
38
- density: 0.53
39
- weight: 0.4
40
- - model: PetroGPT/WestSeverus-7B-DPO
41
- parameters:
42
- density: 0.53
43
- weight: 0.3
44
-
45
- merge_method: dare_ties
46
- base_model: uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b
47
- parameters:
48
- int8_mask: true
49
-
50
- dtype: bfloat16
51
-
52
-
53
- ```
 
7
  tags:
8
  - mergekit
9
  - merge
10
+ license: mit
11
  ---
12
  # merge
13
 
14
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
 
 
16
  ### Merge Method
17
 
18
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b](https://huggingface.co/uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b) as a base.
 
23
  * [PetroGPT/WestSeverus-7B-DPO](https://huggingface.co/PetroGPT/WestSeverus-7B-DPO)
24
  * [vishnukv/WestSeverusJaskier](https://huggingface.co/vishnukv/WestSeverusJaskier)
25