

TITLE
A layman wants to train DistilBERT

COMMENTS
3

REACTIONS
+1: 1
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
    I want to train DistilBERT, but I don't  know how to get the training data.
In the article, it describes the training data as a concatenation of Toronto Book Corpus and English Wikipedia (same training data as the English version of BERT). So how can I get it?
![image](https://user-images.githubusercontent.com/38905736/98760883-378c8f00-240f-11eb-881a-2048e2967617.png)


[https://github.com/huggingface/transformers/blob/1ab8dc44b3d84ed1894f5b6a6fab58fb39298fc7/examples/distillation/README.md](url)