RozGrov commited on
Commit
d8cb6aa
1 Parent(s): 23ce30d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -3
README.md CHANGED
@@ -7,14 +7,26 @@ tags:
7
  - merge
8
 
9
  ---
10
- # NemoDori-v0.2-Frankend.1
11
 
12
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ## Merge Details
15
  ### Merge Method
16
 
17
- This model was merged using the passthrough merge method.
18
 
19
  ### Models Merged
20
 
@@ -26,7 +38,6 @@ The following models were included in the merge:
26
  The following YAML configuration was used to produce this model:
27
 
28
  ```yaml
29
-
30
  slices:
31
  - sources:
32
  - model: RozGrov/NemoDori-v0.2-12B-MN-BT
 
7
  - merge
8
 
9
  ---
10
+ # NemoDori-v0.2-Upscaled.1-14B
11
 
12
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
 
14
+ An upscaled version of [**NemoDori-v0.2-12B-MN-BT**](https://huggingface.co/RozGrov/NemoDori-v0.2-12B-MN-BT), now at **14B**.
15
+ <br>
16
+ This should somehow makes it more clever, if not, it's just my feeling.
17
+ <br>
18
+ NemoDori v0.2 is my best merge model so far, so I want to try if upscaling (or merge using itself) does have any effect on it.
19
+
20
+ As expected, this model can use [v0.1](https://huggingface.co/RozGrov/NemoDori-v0.1-12B-MS) preset and go creative up to temp 2 at least.
21
+ I didn't have enough time to test it, because I made an even MORE upscaled version of v0.2, which will be made public once my work ends.
22
+
23
+ I am glad that this works out. I haven't been able to use `passthrough` method work, mostly the result responds with gibberish and my stupid brain thinking that
24
+ doing something random will magically create what I want. It took me 3 tries to get it right, but still... I didn't know why it work now.
25
+
26
  ## Merge Details
27
  ### Merge Method
28
 
29
+ This model was merged using the `passthrough` merge method.
30
 
31
  ### Models Merged
32
 
 
38
  The following YAML configuration was used to produce this model:
39
 
40
  ```yaml
 
41
  slices:
42
  - sources:
43
  - model: RozGrov/NemoDori-v0.2-12B-MN-BT