Aligning Teacher with Student Preferences for Tailored Training Data Generation Paper • 2406.19227 • Published Jun 27 • 24
Pre-training Distillation for Large Language Models: A Design Space Exploration Paper • 2410.16215 • Published 16 days ago • 15
MiniPLM: Knowledge Distillation for Pre-Training Language Models Paper • 2410.17215 • Published 15 days ago • 12
