MarsupialAI
commited on
Commit
•
b22b024
1
Parent(s):
cb66f13
Upload recipe.txt
Browse files- recipe.txt +14 -0
recipe.txt
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
For each component 7b, do
|
2 |
+
|
3 |
+
Stack A: [0, 28], [12, 32]
|
4 |
+
Stack B: [0, 20], [4, 32]
|
5 |
+
Linear merge:
|
6 |
+
Stack A weight [1, 1, 1, 1, 1, 0.5, 0, 0, 0, 0, 0]
|
7 |
+
Stack B weight [0, 0, 0, 0, 0, 0.5, 1, 1, 1, 1, 1]
|
8 |
+
|
9 |
+
Final merge:
|
10 |
+
- Toppy stack
|
11 |
+
- Buttocks stack
|
12 |
+
- Westlake stack
|
13 |
+
merge_method: model_stock
|
14 |
+
base_model: Mistral stack
|