Wenyu Du

wydu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in llm-stacking/README 5 days ago

Baseline models

1

#1 opened 10 days ago by

esualp

upvoted a collection 4 months ago

Reasoning

Collection

24 items • Updated Oct 4, 2024 • 2

upvoted a collection 5 months ago

🔍 Interpretability & Analysis of LMs

Collection

Outstanding research in LM interpretability and evaluation, summarized • 102 items • Updated about 9 hours ago • 97

updated a model 7 months ago

wydu/Samba

Updated Aug 2, 2024

upvoted a paper 8 months ago

A Closer Look into Mixture-of-Experts in Large Language Models

Paper • 2406.18219 • Published Jun 26, 2024 • 16

authored a paper 8 months ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25, 2024 • 30

commented a paper 8 months ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25, 2024 • 30 •

1

authored a paper 8 months ago

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Paper • 2405.15319 • Published May 24, 2024 • 26

upvoted a paper 8 months ago

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Paper • 2405.15319 • Published May 24, 2024 • 26

updated 11 models 9 months ago

llm-stacking/StackingLaw_Factor_1.1B12L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Factor_1.1B3L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Factor_1.1B1L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B50BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B20BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B5BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B1BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M50BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M20BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M10BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M5BT

Updated Jun 6, 2024 • 1