Biomistral-MOE / mergekit_moe_config.yml
sj2704's picture
Upload folder using huggingface_hub
f5fb76c verified
raw
history blame contribute delete
312 Bytes
base_model: microsoft/phi-2
gate_mode: hidden
dtype: float16
experts:
- source_model: "microsoft/phi-2"
positive_prompts:
- "Chat"
- "Summarize"
- "Help"
- source_model: "vimal52/phi2_medical"
positive_prompts:
- "Doctor"
- "Patient"
- "Medical"
- "Chat"
- "Summarize"