text: 
  
  TITLE
  [Consistency] Automatically set decoder_input_ids for TFEncoderDecoderModel
  
  COMMENTS
  4
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  # 🚀 Feature request
  
  Currently, the `EncoderDecoderModel` class in PyTorch automatically creates the `decoder_input_ids` based on the `labels` provided by the user (similar to how this is done for T5/BART). This should also be implemented for `TFEncoderDecoderModel`, because currently users should manually provide `decoder_input_ids` to the model.
  
  One can take a look at the TF implementation of BART for example to see how to shift the labels in order to automatically create the `decoder_input_ids`, namely [here](https://github.com/huggingface/transformers/blob/29dfb2dbb10cdba6327ff287db56b182c1db29b1/src/transformers/models/bart/modeling_tf_bart.py#L1120).
  
  One should then also update the docstring correspondingly. 
  
  