File size: 532 Bytes
afc7961
 
 
fcd3961
afc7961
 
 
 
 
 
 
 
 
 
 
 
 
 
08cb8fd
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
license: cc-by-nc-4.0
---
This is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. Solidly outperforms Harmonia.

merge_method: task_arithmetic

base_model: athirdpath/Harmonia-20b

models:

  - model: athirdpath/Harmonia-20b
  - model: NeverSleep/Noromaid-20b-v0.1.1

    - parameters: weight: 0.25
  - model: athirdpath/Nethena-20b-Glued
    - parameters: weight: 0.2
    
dtype: float16

Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.