zzzotop
/

zero-shot-cross-lingual-transfer-demo-masked

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

zzzotop commited on Aug 15, 2023

Commit

79fff85

•

1 Parent(s): 6b11a5d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,4 +1,4 @@
-Masked word prediction in 101 languages. To use, input a non-English sentence (you can use Google Translate to get one), replacing one of the words with "<mask>".
 distilbert-base-multilingual-cased finetuned on r/explainlikeimfive subset of ELI5 dataset for English masked language modelling. All knowledge of target language is acquired from pretraining only.
 Training set size 50,000 examples. Trained for 3 epochs. Mask probability 15%, batch size 8, learning rate 2e-5, weight decay 0.01. Final model perplexity 10.22.

+Masked word prediction in 103 languages. To use, input a non-English sentence (you can use Google Translate to get one), replacing one of the words with "<mask>".
 distilbert-base-multilingual-cased finetuned on r/explainlikeimfive subset of ELI5 dataset for English masked language modelling. All knowledge of target language is acquired from pretraining only.
 Training set size 50,000 examples. Trained for 3 epochs. Mask probability 15%, batch size 8, learning rate 2e-5, weight decay 0.01. Final model perplexity 10.22.