text: 
  
  TITLE
  MultiBerts in Huggingface
  
  COMMENTS
  0
  
  REACTIONS
  +1: 4
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 3
  eyes: 0
  
  BODY
  # 🚀 Feature request
  
  It would be nice to have a script/converter of all the [multiberts](https://arxiv.org/pdf/2106.16163.pdf) checkpoints that were released about a month ago.
  It was [released](https://github.com/google-research/language/tree/master/language/multiberts) by Google, thus using tensorflow, and it would be nice to have it under the huggingface library/hub.
  
  <!-- A clear and concise description of the feature proposal.
       Please provide a link to the paper and code in case they exist. -->
  
  ## Motivation
  
  <!-- Please outline the motivation for the proposal. Is your feature request
       related to a problem? e.g., I'm always frustrated when [...]. If this is related
       to another GitHub issue, please link here too. -->
  These checkpoints may be useful to study training dynamics and hypotheses over multiple seeds that were used to train the model.
  