MoE - a FALcon6 Collection

FALcon6 's Collections

MoE

LGViT

MoE

updated Jun 27

Open source MoE

IEITYuan/Yuan2-M32-hf

Text Generation • Updated May 30, 2024 • 252 • 61
allenai/OLMoE-1B-7B-0924

Text Generation • 7B • Updated Oct 19, 2024 • 12.4k • 135
microsoft/Phi-3.5-MoE-instruct

Text Generation • 42B • Updated Mar 7 • 219k • 560
Qwen/Qwen1.5-MoE-A2.7B

Text Generation • 14B • Updated Apr 18, 2024 • 46.6k • 207
deepseek-ai/deepseek-moe-16b-base

Text Generation • 16B • Updated Jan 12, 2024 • 8.56k • 127
deepseek-ai/DeepSeek-V2-Lite

Text Generation • 16B • Updated Jun 25, 2024 • 79k • 150
deepseek-ai/DeepSeek-V2-Lite-Chat

Text Generation • 16B • Updated Jun 25, 2024 • 262k • 131
mistralai/Mixtral-8x7B-v0.1

47B • Updated Jul 24 • 43.7k • 1.76k
databricks/dbrx-base

Text Generation • 132B • Updated Apr 19, 2024 • 560
microsoft/Phi-mini-MoE-instruct

Text Generation • 8B • Updated Jul 23 • 7.01k • 22
microsoft/Phi-tiny-MoE-instruct

Text Generation • 4B • Updated Jul 23 • 3.87k • 24