paimonimpact commited on
Commit
ecffa18
1 Parent(s): 7d9902f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -4
README.md CHANGED
@@ -1,15 +1,17 @@
1
  ---
2
  license: creativeml-openrail-m
3
  ---
4
- ACertaintyベースのモデル群です。
5
  レシピに表記されているチェックポイントにNAIが含まれていなければNAIリークフリーのモデルになります。
6
- DataSet(キャプションのみ): [https://huggingface.co/datasets/paimonimpact/ONN](https://huggingface.co/datasets/paimonimpact/ONN)
 
 
7
  ## ONN_anyV3.fp16.safetensors
8
  ▼Use Models
9
  - ACertainty.ckpt
10
  - bp_1024_e10.ckpt
11
 
12
- ACertaintyにany_A~FのデータセットでDB。
13
 
14
  | Model: A | Model: B | Weight | Base alpha | Merge Name |
15
  | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
@@ -37,4 +39,54 @@ ACertaintyにany_A~FのデータセットでDB。
37
 
38
  | Model: A | Model: B | Weight | Base alpha | Merge Name |
39
  | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
40
- | ONN_anyV3 | onn_real | 0,1.0,0.9,0.7,0.5,0.3,0.1,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7,0.9,1.0 | 0 | ONN_AOM2 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: creativeml-openrail-m
3
  ---
4
+ NAIの含まれる各種モデルをACertaintyベースで再現しようという試みです。
5
  レシピに表記されているチェックポイントにNAIが含まれていなければNAIリークフリーのモデルになります。
6
+ マージはよく分からないので適当にマージしてください。
7
+ 蒸留画像は使用していません。下記のレポジトリからデータセットのキャプションのみダウンロードできます。
8
+ DataSet: [https://huggingface.co/datasets/paimonimpact/ONN](https://huggingface.co/datasets/paimonimpact/ONN)
9
  ## ONN_anyV3.fp16.safetensors
10
  ▼Use Models
11
  - ACertainty.ckpt
12
  - bp_1024_e10.ckpt
13
 
14
+ ACertaintyにany_A ~ FのデータセットでDB。
15
 
16
  | Model: A | Model: B | Weight | Base alpha | Merge Name |
17
  | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
 
39
 
40
  | Model: A | Model: B | Weight | Base alpha | Merge Name |
41
  | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
42
+ | ONN_anyV3 | onn_real | 0,1.0,0.9,0.7,0.5,0.3,0.1,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7,0.9,1.0 | 0 | ONN_AOM2 |
43
+
44
+ ## ONN_anyV4.fp16.safetensors
45
+ ▼Use Models
46
+ - ACertainty.ckpt
47
+ - ONN_AOM2.fp16.safetensors
48
+
49
+ 1. ACertaintyをanyV4.zipのデータセットでFT = FT_ACertainty
50
+ 2. ONN_AOM2と単純マージ
51
+ | Model: A | Model: B | Base alpha | Merge Name |
52
+ | ------------ | -------- | ---------- | ------------------- |
53
+ | FT_ACertainty | ONN_AOM2 | 0.5 | ONN_anyV4 |
54
+
55
+ ## ONN_pastel.fp16.safetensors
56
+ ▼Use Models
57
+ - bp_1024_e10.ckpt
58
+ - ONN_AOM2.fp16.safetensors
59
+ - onn_real.fp16.safetensors
60
+
61
+ 1. pastel_A ~ EのデータセットでLoRaを5つ作成 = onnpastelLoRaA~E
62
+ 2. ONN_AOM2とpastelLoRAをマージ
63
+ | Model | Lora | Weight | Merge Name |
64
+ | --- | --- | --- | --- |
65
+ | ONN_AOM2 | onnpastelLoRaA | 0.8 | onnpastel_baseA |
66
+ 3. onnpastel_baseAとbp_1024_e10.ckptをマージ
67
+ 4. | Model: A | Model: B | Base alpha | Merge Name |
68
+ | ------------ | -------- | ---------- | ------------------- |
69
+ | onnpastel_baseA | baseAとbp_1024_e1 | 0.5 | onnpastel_baseB |
70
+
71
+ 5. ACertaintyをany_C.zipのデータセットでFT = onnpastel_baseC
72
+ 6. onnpastel_baseBとonnpastel_baseCをマージ
73
+ | Model: A | Model: B | Base alpha | Merge Name |
74
+ | ------------ | -------- | ---------- | ------------------- |
75
+ | onnpastel_baseB |onnpastel_baseC | 0.5 | onnpastel_baseBC |
76
+ 7. onnpastel_baseBCとonn_realをマージ
77
+ | Model: A | Model: B | Weight | Base alpha | Merge Name |
78
+ | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
79
+ | onnpastel_baseBC | onn_real | 1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0 | 0 | onnpastel |
80
+ 8. 各種LoRAをマージ
81
+ | Model | Lora | Weight | Merge Name |
82
+ | --- | --- | --- | --- |
83
+ | onnpastel | onnpastelLoRaB | 0.2 | onnpastel-1 |
84
+ | onnpastel-1 | onnpastelLoRaC | 0.3 | onnpastel-2 |
85
+ | onnpastel-2 | onnpastelLoRaD | 0.5 | onnpastel-3 |
86
+ | onnpastel-3 | onnpastelLoRaE | 0.6 | onnpastel-4 |
87
+ | onnpastel-4 | onnpastelLoRaA | 0.2 | onnpastel-5 |
88
+
89
+ 9. 再度マージして微調整
90
+ | Model: A | Model: B | Weight | Base alpha | Merge Name |
91
+ | ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
92
+ | onnpastel-5 | onnpastel_baseC | 0.7,0.5,0.3,0.1,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7 | 0 | ONN_pastel |