Update README.md
Browse files
README.md
CHANGED
@@ -2,7 +2,7 @@
|
|
2 |
license: bigscience-bloom-rail-1.0
|
3 |
---
|
4 |
Multilingual Generative Pretrained Transformer with 176B parameters with capacity for Finnish.
|
5 |
-
This model is built upon pretrained [BLOOM](https://huggingface.co/bigscience/bloom) which is then further pretrained with ROOTS + Finnish for 40B tokens.
|
6 |
|
7 |
|
8 |
**Datasets**
|
|
|
2 |
license: bigscience-bloom-rail-1.0
|
3 |
---
|
4 |
Multilingual Generative Pretrained Transformer with 176B parameters with capacity for Finnish.
|
5 |
+
This model is built upon pretrained [BLOOM](https://huggingface.co/bigscience/bloom) which is then further pretrained with a combined ROOTS + Finnish (without weighting) dataset for 40B tokens.
|
6 |
|
7 |
|
8 |
**Datasets**
|