

TITLE
[Deepspeed] add many more models to the model zoo test 

COMMENTS
3

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
This PR continues figuring out how to make various models work with Deepspeed (a lot of fixes happen on the Deepspeed side), most models just work out of the box - the main purpose of this PR is to test as many models as possible. so there are no fixes to add.

- [x] update coverage to albert, bart, bert, bigbird_pegasus, big_bird, blenderbot, deberta, deberta_v2, distilbert, electra, flaubert, fsmt, funnel, gpt2, gptj, gpt_neo, layoutlm, led, longformer, marian, mbart, mobilebert, mpnet, pegasus, prophetnet, roberta, squeezebert, t5, t5_v1, vit, xlm_roberta, xlnet

Thanks to @LysandreJik for creating the tiny test models for many of HF models!

Some models I couldn't cover for a variety of reasons unrelated to Deepspeed (missing tokenizers, missing tiny models, missing example scripts to exercise these). But their status is documented in the script. Over time more will be tested.

Blocking events - all resolved:

- [x] https://github.com/microsoft/DeepSpeed/pull/1227 (fixes reference counting)
- [x] https://github.com/microsoft/DeepSpeed/pull/1380 (fixes zero_to_fp32 recovery of uneven param shapes)
- [x] https://github.com/huggingface/transformers/pull/13665 (fixes positional embeddings: m2m_100 and others)
- [x] https://github.com/microsoft/DeepSpeed/pull/1916#event-6563217392 (fixes tracing)
- [x] 0.6.4 Deepspeed release that includes all the merged PRs

