2xMistral / mergekit_moe_config.yml
AbstractPerspective's picture
Upload folder using huggingface_hub
23aa994 verified
raw
history blame contribute delete
No virus
223 Bytes
base_model: mistralai/Mistral-7B-v0.1
gate_mode: cheap_embed
experts:
- source_model: mistralai/Mistral-7B-v0.1
positive_prompts: ["general"]
- source_model: mlabonne/drmistral-7b
positive_prompts: ["medical"]