Update README.md
Browse files
README.md
CHANGED
@@ -7,14 +7,26 @@ tags:
|
|
7 |
- merge
|
8 |
|
9 |
---
|
10 |
-
# NemoDori-v0.2-
|
11 |
|
12 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
## Merge Details
|
15 |
### Merge Method
|
16 |
|
17 |
-
This model was merged using the passthrough merge method.
|
18 |
|
19 |
### Models Merged
|
20 |
|
@@ -26,7 +38,6 @@ The following models were included in the merge:
|
|
26 |
The following YAML configuration was used to produce this model:
|
27 |
|
28 |
```yaml
|
29 |
-
|
30 |
slices:
|
31 |
- sources:
|
32 |
- model: RozGrov/NemoDori-v0.2-12B-MN-BT
|
|
|
7 |
- merge
|
8 |
|
9 |
---
|
10 |
+
# NemoDori-v0.2-Upscaled.1-14B
|
11 |
|
12 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
13 |
|
14 |
+
An upscaled version of [**NemoDori-v0.2-12B-MN-BT**](https://huggingface.co/RozGrov/NemoDori-v0.2-12B-MN-BT), now at **14B**.
|
15 |
+
<br>
|
16 |
+
This should somehow makes it more clever, if not, it's just my feeling.
|
17 |
+
<br>
|
18 |
+
NemoDori v0.2 is my best merge model so far, so I want to try if upscaling (or merge using itself) does have any effect on it.
|
19 |
+
|
20 |
+
As expected, this model can use [v0.1](https://huggingface.co/RozGrov/NemoDori-v0.1-12B-MS) preset and go creative up to temp 2 at least.
|
21 |
+
I didn't have enough time to test it, because I made an even MORE upscaled version of v0.2, which will be made public once my work ends.
|
22 |
+
|
23 |
+
I am glad that this works out. I haven't been able to use `passthrough` method work, mostly the result responds with gibberish and my stupid brain thinking that
|
24 |
+
doing something random will magically create what I want. It took me 3 tries to get it right, but still... I didn't know why it work now.
|
25 |
+
|
26 |
## Merge Details
|
27 |
### Merge Method
|
28 |
|
29 |
+
This model was merged using the `passthrough` merge method.
|
30 |
|
31 |
### Models Merged
|
32 |
|
|
|
38 |
The following YAML configuration was used to produce this model:
|
39 |
|
40 |
```yaml
|
|
|
41 |
slices:
|
42 |
- sources:
|
43 |
- model: RozGrov/NemoDori-v0.2-12B-MN-BT
|