text: 
  
  TITLE
  [deepspeed] supporting `--adafactor` 
  
  COMMENTS
  0
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  It was flagged that in this example https://github.com/huggingface/transformers/issues/11044 `--adafactor` is used, but Deepspeed doesn't get it passed since the DS config's optimizer overrides it. So need to sort it out.