distilbert-mlm-500k / README.md
nreimers's picture
upload
26a5b9c
|
raw
history blame
105 Bytes
distilbert-base-uncased trained for 500K steps with batch size 64 on C4, MSMARCO, Wikipedia, S2ORC, News