yulan-team/YuLan-Mini
Text Generation
•
Updated
•
789
•
35
YuLan-Mini
A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
Note A highly capable 2.4B lightweight LLM using only 1T pre-training data.
-
yulan-team/YuLan-Mini-Instruct-V1
Text Generation • Updated • 62 • 2 -
yulan-team/YuLan-Mini-Datasets
Updated • 973 • 9 -
YuLan-Mini: An Open Data-efficient Language Model
Paper • 2412.17743 • Published • 64
yulan-team/YuLan-Mini-Before-Annealing
Updated • 20 • 7Note The model & optimizer states of the last curriculum phase before learning rate annealing.
yulan-team/YuLan-Mini-Phase20
Updated • 18 • 2Note The model & optimizer states of the 20th curriculum phase.