text: 
  
  TITLE
  [deepspeed] --gradient_accumulation_steps fix
  
  COMMENTS
  0
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  This PR fixes deepspeed integration to run `self.deepspeed.step()` instead of `optimizer.step()` + adds test. As it was failing when `--gradient_accumulation_steps 2` was added.
  
  Thank you @jncasey for detecting this bug in https://github.com/microsoft/DeepSpeed/issues/671
  
  @sgugger 