DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Paper
•
2305.10429
•
Published
•
3
Papers - Training - AI training AI
-
-
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
Paper • 2403.15042 • Published • 25 -
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
Paper • 2405.01535 • Published • 118 -
Discovering Preference Optimization Algorithms with and for Large Language Models
Paper • 2406.08414 • Published • 13 -
Distilling System 2 into System 1
Paper • 2407.06023 • Published • 3