A curated collection of machine translation datasets
Pietro Lesci
pietrolesci
AI & ML interests
I am passionate about the science of language models: developing and applying causal methods—drawing from econometrics—to study the effect of training choices on models’ behaviour, including memorisation, shortcut learning, and tokenisation.
Organizations
spaces
1
models
16
pietrolesci/raw_tokenisers
Updated
pietrolesci/tokenisers
Updated
pietrolesci/SmolLM-34M-tok32000
Updated
pietrolesci/bert-civilcomments-gradtracking
Updated
pietrolesci/roberta-base_mnli_b9799b8f9b
Updated
pietrolesci/bert-base-uncased_mnli_53fb0761e0
Updated
pietrolesci/bert-tiny_mnli_cdc7ea0d50
Updated
pietrolesci/pythia-14m_2024-01-17T00-07-52
Updated
pietrolesci/gpt2_wikitext-103-raw-v1_L2-H4-E256-C256
Updated
pietrolesci/gpt2_wikitext-2-raw-v1_L2-H4-E256-C256
Updated
datasets
53
pietrolesci/opus-raw
Viewer
•
Updated
•
3.84B
•
190
pietrolesci/minipile
Viewer
•
Updated
•
4.04M
•
81
pietrolesci/finewebedu-20BT
Updated
•
32
pietrolesci/fineweb-edu-10BT
Updated
•
53
pietrolesci/_minipile
Viewer
•
Updated
•
2.51M
•
73
pietrolesci/pythia-pile-stats
Viewer
•
Updated
•
113M
•
47
pietrolesci/slim-pajama-eval
Viewer
•
Updated
•
1.84M
•
40
•
1
pietrolesci/pile-subset
Updated
•
38
pietrolesci/pile_preshuffled_seeds
Updated
•
17
•
1
pietrolesci/cmnist
Viewer
•
Updated
•
308k
•
90