FallenMerick commited on
Commit
bff940c
1 Parent(s): 5bbdb19

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -44
README.md CHANGED
@@ -1,44 +1,45 @@
1
- ---
2
- base_model:
3
- - NeverSleep/X-NoroChronos-13B
4
- - NeverSleep/Noromaid-13b-v0.3
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # XNoroChronos-Orca2-Noromaid-1
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [NeverSleep/X-NoroChronos-13B](https://huggingface.co/NeverSleep/X-NoroChronos-13B) as a base.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
24
- * E:\Machine Learning\Models\Orca2-Flat-BF16
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
- models:
32
- - model: NeverSleep/X-NoroChronos-13B
33
- - model: E:\Machine Learning\Models\Orca2-Flat-BF16
34
- parameters:
35
- weight: 1.0
36
- density: 0.4
37
- - model: NeverSleep/Noromaid-13b-v0.3
38
- parameters:
39
- weight: 1.0
40
- density: 0.2
41
- merge_method: ties
42
- base_model: NeverSleep/X-NoroChronos-13B
43
- dtype: bfloat16
44
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - NeverSleep/X-NoroChronos-13B
4
+ - TeeZee/Orca-2-13b_flat
5
+ - NeverSleep/Noromaid-13b-v0.3
6
+ library_name: transformers
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+
11
+ ---
12
+ # XNoroChronos-Orca2-Noromaid
13
+
14
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
+
16
+ ## Merge Details
17
+ ### Merge Method
18
+
19
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method.
20
+
21
+ ### Models Merged
22
+
23
+ The following models were included in the merge:
24
+ * [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
25
+ * [TeeZee/Orca-2-13b_flat](https://huggingface.co/TeeZee/Orca-2-13b_flat)
26
+
27
+ ### Configuration
28
+
29
+ The following YAML configuration was used to produce this model:
30
+
31
+ ```yaml
32
+ models:
33
+ - model: NeverSleep/X-NoroChronos-13B
34
+ - model: TeeZee/Orca-2-13b_flat
35
+ parameters:
36
+ weight: 1.0
37
+ density: 0.4
38
+ - model: NeverSleep/Noromaid-13b-v0.3
39
+ parameters:
40
+ weight: 1.0
41
+ density: 0.2
42
+ merge_method: ties
43
+ base_model: NeverSleep/X-NoroChronos-13B
44
+ dtype: bfloat16
45
+ ```