Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ tags:
|
|
9 |
- encode-decoder
|
10 |
---
|
11 |
|
12 |
-
Pile-T5
|
13 |
|
14 |
### Model Details
|
15 |
|
|
|
9 |
- encode-decoder
|
10 |
---
|
11 |
|
12 |
+
Pile-T5 XL is an Encoder-Decoder model trained on [the Pile](https://pile.eleuther.ai/) using the [T5x](https://github.com/google-research/t5x) library. The model was trained for 2 million steps or roughly 2 trillion tokens using MLM-objective similar to the original T5 model.
|
13 |
|
14 |
### Model Details
|
15 |
|