qwerrwe / deepspeed /zero3.json

Commit History

set auto for other params that hf trainer sets for ds. include zero1 json (#570)
3b18c96
unverified

winglian commited on

set zero3 optimizer betas to auto so they inherit from HF trainer config (#507)
1e07c16
unverified

tmm1 commited on

add a basic ds zero3 config (#347)
bb53a16
unverified

winglian commited on