Steelskull
commited on
Commit
•
0f09075
1
Parent(s):
07e18df
Update README.md
Browse files
README.md
CHANGED
@@ -22,9 +22,13 @@ Thinking about finetuning on a RP dataset later on to direct the model more
|
|
22 |
### Model Sources [optional]
|
23 |
|
24 |
model_name: Lumosia-MoE-4x10.7
|
|
|
25 |
base_model: DopeorNope/SOLARC-M-10.7B
|
|
|
26 |
gate_mode: hidden
|
|
|
27 |
dtype: bfloat16
|
|
|
28 |
experts:
|
29 |
- source_model: DopeorNope/SOLARC-M-10.7B
|
30 |
positive_prompts: [""]
|
|
|
22 |
### Model Sources [optional]
|
23 |
|
24 |
model_name: Lumosia-MoE-4x10.7
|
25 |
+
|
26 |
base_model: DopeorNope/SOLARC-M-10.7B
|
27 |
+
|
28 |
gate_mode: hidden
|
29 |
+
|
30 |
dtype: bfloat16
|
31 |
+
|
32 |
experts:
|
33 |
- source_model: DopeorNope/SOLARC-M-10.7B
|
34 |
positive_prompts: [""]
|