vocab-transformers
/

distilbert-mlm-500k

File size: 105 Bytes

26a5b9c

distilbert-base-uncased trained for 500K steps with batch size 64 on C4, MSMARCO, Wikipedia, S2ORC, News