

TITLE
[Marian] Doc says `config.add_bias_logits=True`, but config is has `config.add_bias_logits=False`

COMMENTS
2

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
**Question**:

In the docs, it is written that Marian has (contrary to Bart), `config.add_bias_logits=True`: https://huggingface.co/transformers/model_doc/marian.html#implementation-notes. But when looking into the code: 
https://github.com/huggingface/transformers/blob/b01f451ca38695c60175b34d245997ef4d18231d/src/transformers/models/marian/configuration_marian.py#L25 Marian has the exact same default config as Bart and also Marian's config files online have `config.add_bias_logits=False` - see:
https://huggingface.co/Helsinki-NLP/opus-mt-en-de/resolve/main/config.json

@sshleifer @patil-suraj 

Is the documentation not up-to-date anymore? Because all the slow tests are passing....
