

TITLE
Adding m2m100 12B

COMMENTS
6

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
# 🌟 New model addition

Hi!

I was wondering if there's been any work on adding the 12B version of m2m100 model to huggingface.
Given libraries such as fairscale or parallelformers, inference with these relatively big models should be possible now.
Are there any model changes needed to accommodate the 12B version? And does the current m2m100 [conversion script](https://github.com/huggingface/transformers/blob/master/src/transformers/models/m2m_100/convert_m2m100_original_checkpoint_to_pytorch.py) work for it?

## Open source status

* [X] the model weights are available: [link](https://github.com/pytorch/fairseq/blob/master/examples/m2m_100/README.md#12b-model)

Tagging @patil-suraj who added m2m100.
