Hugging Face's logo

DavidAU
/
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B

Text Generation
Transformers
Safetensors
mixtral
mergekit
Mixture of Experts
mixture of experts
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
DavidAU commited on
Commit
5f99da4
·
verified ·
1 Parent(s): 9dc2f8f

Delete mergekit_moe_config.yml

Browse files
Files changed (1) hide show
  1. mergekit_moe_config.yml +0 -14
mergekit_moe_config.yml DELETED
@@ -1,14 +0,0 @@
1
- base_model: E:/L3-Dark-Planet-8B-wordstorm-b6
2
- gate_mode: random
3
- dtype: bfloat16
4
- experts_per_token: 2
5
- experts:
6
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-b3
7
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-b4
8
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-r1
9
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-b6
10
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-cr2
11
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-cr2
12
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-r7
13
- - source_model: E:/L3-Dark-Planet-8B-wordstorm-r6
14
-