

TITLE
Error building extension 'fused_adam'

COMMENTS
4

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
Hi,

I recently updated `transformers` to `4.4.2` for `DebertaV2` and while training DebertaV2 with DeepSpeed, got an error regarding `deepspeed` version. So I upgraded to latest deepspeed (0.3.13) and started training and getting this error - 

**RuntimeError: Error building extension 'fused_adam'**

Here is the env info - 
![image](https://user-images.githubusercontent.com/41769919/111992621-a0151680-8b3b-11eb-8f6f-eea89cd0e9a8.png)

`transformers - 4.4.2`

Also tried with torch==1.8.0+cu101 and getting same error.
I was able to train with deepspeed using `transformers-4.3.2` and `deepspeed-0.3.10`. Plz suggest how to proceed further..
