Jan Schmitz

JanSchTech's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted 2 articles over 1 year ago

view article

Article

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

• 

May 7, 2024

•

111

view article

Article

Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity

• 

Mar 18, 2024

•

13