paimonimpact
commited on
Commit
•
ecffa18
1
Parent(s):
7d9902f
Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,17 @@
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
3 |
---
|
4 |
-
ACertainty
|
5 |
レシピに表記されているチェックポイントにNAIが含まれていなければNAIリークフリーのモデルになります。
|
6 |
-
|
|
|
|
|
7 |
## ONN_anyV3.fp16.safetensors
|
8 |
▼Use Models
|
9 |
- ACertainty.ckpt
|
10 |
- bp_1024_e10.ckpt
|
11 |
|
12 |
-
ACertaintyにany_A~FのデータセットでDB。
|
13 |
|
14 |
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
15 |
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
@@ -37,4 +39,54 @@ ACertaintyにany_A~FのデータセットでDB。
|
|
37 |
|
38 |
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
39 |
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
40 |
-
| ONN_anyV3 | onn_real | 0,1.0,0.9,0.7,0.5,0.3,0.1,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7,0.9,1.0 | 0 | ONN_AOM2 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
3 |
---
|
4 |
+
NAIの含まれる各種モデルをACertaintyベースで再現しようという試みです。
|
5 |
レシピに表記されているチェックポイントにNAIが含まれていなければNAIリークフリーのモデルになります。
|
6 |
+
マージはよく分からないので適当にマージしてください。
|
7 |
+
蒸留画像は使用していません。下記のレポジトリからデータセットのキャプションのみダウンロードできます。
|
8 |
+
DataSet: [https://huggingface.co/datasets/paimonimpact/ONN](https://huggingface.co/datasets/paimonimpact/ONN)
|
9 |
## ONN_anyV3.fp16.safetensors
|
10 |
▼Use Models
|
11 |
- ACertainty.ckpt
|
12 |
- bp_1024_e10.ckpt
|
13 |
|
14 |
+
ACertaintyにany_A ~ FのデータセットでDB。
|
15 |
|
16 |
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
17 |
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
|
|
39 |
|
40 |
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
41 |
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
42 |
+
| ONN_anyV3 | onn_real | 0,1.0,0.9,0.7,0.5,0.3,0.1,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7,0.9,1.0 | 0 | ONN_AOM2 |
|
43 |
+
|
44 |
+
## ONN_anyV4.fp16.safetensors
|
45 |
+
▼Use Models
|
46 |
+
- ACertainty.ckpt
|
47 |
+
- ONN_AOM2.fp16.safetensors
|
48 |
+
|
49 |
+
1. ACertaintyをanyV4.zipのデータセットでFT = FT_ACertainty
|
50 |
+
2. ONN_AOM2と単純マージ
|
51 |
+
| Model: A | Model: B | Base alpha | Merge Name |
|
52 |
+
| ------------ | -------- | ---------- | ------------------- |
|
53 |
+
| FT_ACertainty | ONN_AOM2 | 0.5 | ONN_anyV4 |
|
54 |
+
|
55 |
+
## ONN_pastel.fp16.safetensors
|
56 |
+
▼Use Models
|
57 |
+
- bp_1024_e10.ckpt
|
58 |
+
- ONN_AOM2.fp16.safetensors
|
59 |
+
- onn_real.fp16.safetensors
|
60 |
+
|
61 |
+
1. pastel_A ~ EのデータセットでLoRaを5つ作成 = onnpastelLoRaA~E
|
62 |
+
2. ONN_AOM2とpastelLoRAをマージ
|
63 |
+
| Model | Lora | Weight | Merge Name |
|
64 |
+
| --- | --- | --- | --- |
|
65 |
+
| ONN_AOM2 | onnpastelLoRaA | 0.8 | onnpastel_baseA |
|
66 |
+
3. onnpastel_baseAとbp_1024_e10.ckptをマージ
|
67 |
+
4. | Model: A | Model: B | Base alpha | Merge Name |
|
68 |
+
| ------------ | -------- | ---------- | ------------------- |
|
69 |
+
| onnpastel_baseA | baseAとbp_1024_e1 | 0.5 | onnpastel_baseB |
|
70 |
+
|
71 |
+
5. ACertaintyをany_C.zipのデータセットでFT = onnpastel_baseC
|
72 |
+
6. onnpastel_baseBとonnpastel_baseCをマージ
|
73 |
+
| Model: A | Model: B | Base alpha | Merge Name |
|
74 |
+
| ------------ | -------- | ---------- | ------------------- |
|
75 |
+
| onnpastel_baseB |onnpastel_baseC | 0.5 | onnpastel_baseBC |
|
76 |
+
7. onnpastel_baseBCとonn_realをマージ
|
77 |
+
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
78 |
+
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
79 |
+
| onnpastel_baseBC | onn_real | 1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0 | 0 | onnpastel |
|
80 |
+
8. 各種LoRAをマージ
|
81 |
+
| Model | Lora | Weight | Merge Name |
|
82 |
+
| --- | --- | --- | --- |
|
83 |
+
| onnpastel | onnpastelLoRaB | 0.2 | onnpastel-1 |
|
84 |
+
| onnpastel-1 | onnpastelLoRaC | 0.3 | onnpastel-2 |
|
85 |
+
| onnpastel-2 | onnpastelLoRaD | 0.5 | onnpastel-3 |
|
86 |
+
| onnpastel-3 | onnpastelLoRaE | 0.6 | onnpastel-4 |
|
87 |
+
| onnpastel-4 | onnpastelLoRaA | 0.2 | onnpastel-5 |
|
88 |
+
|
89 |
+
9. 再度マージして微調整
|
90 |
+
| Model: A | Model: B | Weight | Base alpha | Merge Name |
|
91 |
+
| ------------ | -------- | --------------------------------------------------------------------- | ---------- | ------------------- |
|
92 |
+
| onnpastel-5 | onnpastel_baseC | 0.7,0.5,0.3,0.1,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.3,0.5,0.7 | 0 | ONN_pastel |
|