Update README.md
Browse files
README.md
CHANGED
@@ -64,7 +64,7 @@ For the uses of the model, please refer to [BLOOM](https://huggingface.co/bigsci
|
|
64 |
## Training Data
|
65 |
*This section provides a high-level overview of the training data. It is relevant for anyone who wants to know the basics of what the model is learning.*
|
66 |
|
67 |
-
We trained the
|
68 |
|
69 |
## Risks and Limitations
|
70 |
*This section identifies foreseeable harms and misunderstandings.*
|
|
|
64 |
## Training Data
|
65 |
*This section provides a high-level overview of the training data. It is relevant for anyone who wants to know the basics of what the model is learning.*
|
66 |
|
67 |
+
We trained the 3B parameter model on a total of 13 Billion tokens of mostly high quality Traditional Chinese text. Details are provided in the [paper](https://arxiv.org/abs/2303.04715).
|
68 |
|
69 |
## Risks and Limitations
|
70 |
*This section identifies foreseeable harms and misunderstandings.*
|