

TITLE
[Deepspeed] various fixes

COMMENTS
1

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
This PR includes a few small fixes in config files, tests and docs:

- replace deprecated config `cpu_offload` with `offload_optimizer`
- `sub_group_size` setting was too big - needing too much GPU RAM

@sgugger 