On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
Paper
•
2306.13649
•
Published
•
20
Jed Tiotuico
jed-tiotuico
AI & ML interests
Improving small models by distillation from larger models
Recent Activity
liked
a Space
8 days ago
open-r1/README
updated
a model
10 days ago
jed-tiotuico/twitter-llama
liked
a model
19 days ago
mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit
Organizations
None yet
jed-tiotuico's activity
upvoted
a
paper
8 months ago
upvoted
an
article
8 months ago
Article
Welcome Gemma 2 - Google's new open LLM
•
128