set auto for other params that hf trainer sets for ds. include zero1 json (#570) 3b18c96 unverified winglian commited on Sep 14, 2023
set zero3 optimizer betas to auto so they inherit from HF trainer config (#507) 1e07c16 unverified tmm1 commited on Aug 30, 2023
Feat(deepspeed): Add zero2 config (#476) 3fc9006 unverified mhenrichsen mhenrichsen commited on Aug 27, 2023