Update README.md
Browse filesUpdate pipeline and datasets
README.md
CHANGED
@@ -1,5 +1,9 @@
|
|
1 |
---
|
2 |
language: en
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
# 90% Sparse BERT-Large (uncased) Prune OFA
|
5 |
This model is a result from our paper [Prune Once for All: Sparse Pre-Trained Language Models](https://arxiv.org/abs/2111.05754) presented in ENLSP NeurIPS Workshop 2021.
|
|
|
1 |
---
|
2 |
language: en
|
3 |
+
tags: fill-mask
|
4 |
+
datasets:
|
5 |
+
- wikipedia
|
6 |
+
- bookcorpus
|
7 |
---
|
8 |
# 90% Sparse BERT-Large (uncased) Prune OFA
|
9 |
This model is a result from our paper [Prune Once for All: Sparse Pre-Trained Language Models](https://arxiv.org/abs/2111.05754) presented in ENLSP NeurIPS Workshop 2021.
|