colable commited on
Commit
30e1692
1 Parent(s): c30b05c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -23
README.md CHANGED
@@ -21,26 +21,3 @@ This model was merged using the SLERP merge method.
21
  The following models were included in the merge:
22
  * [JaeyeonKang/CCK-v1.0.0-DPO](https://huggingface.co/JaeyeonKang/CCK-v1.0.0-DPO)
23
  * [LDCC/LDCC-SOLAR-10.7B](https://huggingface.co/LDCC/LDCC-SOLAR-10.7B)
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- base_model: LDCC/LDCC-SOLAR-10.7B
31
- dtype: float16
32
- merge_method: slerp
33
- parameters:
34
- t:
35
- - filter: self_attn
36
- value: [0.0, 0.5, 0.3, 0.7, 1.0]
37
- - filter: mlp
38
- value: [1.0, 0.5, 0.7, 0.3, 0.0]
39
- - value: 0.5
40
- slices:
41
- - sources:
42
- - layer_range: [0, 48]
43
- model: LDCC/LDCC-SOLAR-10.7B
44
- - layer_range: [0, 48]
45
- model: JaeyeonKang/CCK-v1.0.0-DPO
46
- ```
 
21
  The following models were included in the merge:
22
  * [JaeyeonKang/CCK-v1.0.0-DPO](https://huggingface.co/JaeyeonKang/CCK-v1.0.0-DPO)
23
  * [LDCC/LDCC-SOLAR-10.7B](https://huggingface.co/LDCC/LDCC-SOLAR-10.7B)