text: 
  
  TITLE
  quick questions about the `BertModelLMHeadModel`.
  
  COMMENTS
  2
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  Hello,
  I have a few questions about the `BertModelLMHeadModel`:
  
  1. Is `BertModelLMHeadModel`  used to conduct the causal language modeling (next token prediction), as it is the case for the `GPT2LMHeadModel`?
  
  2. For `GPT2LMHeadModel`, I can just specify `labels = input_ids` for convenience. I just specify the `labels` in this way for the `BertModelLMHeadModel` as well?
  
  Thanks,