Falcon3-2x10B-MoE-Instruct / mergekit_moe_config.yml
qingy2024's picture
Upload folder using huggingface_hub
e226b1f verified
raw
history blame contribute delete
306 Bytes
base_model: tiiuae/Falcon3-10B-Instruct
gate_mode: random
architecture: mixtral
dtype: bfloat16
experts:
- source_model: tiiuae/Falcon3-10B-Instruct
positive_prompts:
- "Help me write a story"
- source_model: tiiuae/Falcon3-10B-Instruct
positive_prompts:
- "Can you explain this?"