qwerrwe / deepspeed /zero3.json

Commit History

Remove learning rate scheduler in deepspeed config to avoid conflict (#909)
476a205
unverified

Haoxiang-Wang commited on

Fix Deepspeed Zero3 Config (#791)
d3193be
unverified

Teknium commited on

update README w deepspeed info (#605)
c25ba79
unverified

winglian commited on

set auto for other params that hf trainer sets for ds. include zero1 json (#570)
3b18c96
unverified

winglian commited on

set zero3 optimizer betas to auto so they inherit from HF trainer config (#507)
1e07c16
unverified

tmm1 commited on

add a basic ds zero3 config (#347)
bb53a16
unverified

winglian commited on