Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ license: llama3.1
|
|
23 |
|
24 |
SEA-LION is a collection of Large Language Models (LLMs) which have been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
|
25 |
|
26 |
-
Llama3.1 70B CPT SEA-LIONv3 Instruct is a multilingual model that has been fine-tuned in two stages on approximately **12.3M English instruction-completion pairs** alongside a pool of **4.5M Southeast Asian instruction-completion pairs** from SEA languages such as Indonesian, Tamil, Thai, and Vietnamese.
|
27 |
|
28 |
SEA-LION stands for _Southeast Asian Languages In One Network_.
|
29 |
|
@@ -35,7 +35,7 @@ SEA-LION stands for _Southeast Asian Languages In One Network_.
|
|
35 |
|
36 |
## Model Details
|
37 |
### Model Description
|
38 |
-
We performed instruction tuning in English and also in SEA languages such as Indonesian, Tamil, Thai and Vietnamese on our [continued pre-trained Llama3.1 70B CPT SEA-LIONv3 Base](https://huggingface.co/aisingapore/llama3.1-70B-cpt-sea-lionv3-base), a decoder model using the Llama 3.1 architecture, to create Llama3.1 70B CPT SEA-LIONv3 Instruct.
|
39 |
|
40 |
For tokenisation, the model employs the default tokenizer used in Llama 3.1 70B Instruct. The model has a context length of 128k.
|
41 |
|
|
|
23 |
|
24 |
SEA-LION is a collection of Large Language Models (LLMs) which have been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
|
25 |
|
26 |
+
Llama3.1 70B CPT SEA-LIONv3 Instruct is a multilingual model that has been fine-tuned in two stages on approximately **12.3M English instruction-completion pairs** alongside a pool of **4.5M Southeast Asian instruction-completion pairs** from SEA languages such as Indonesian, Javanese, Sundanese, Tamil, Thai, and Vietnamese.
|
27 |
|
28 |
SEA-LION stands for _Southeast Asian Languages In One Network_.
|
29 |
|
|
|
35 |
|
36 |
## Model Details
|
37 |
### Model Description
|
38 |
+
We performed instruction tuning in English and also in SEA languages such as Indonesian, Javanese, Sundanese, Tamil, Thai and Vietnamese on our [continued pre-trained Llama3.1 70B CPT SEA-LIONv3 Base](https://huggingface.co/aisingapore/llama3.1-70B-cpt-sea-lionv3-base), a decoder model using the Llama 3.1 architecture, to create Llama3.1 70B CPT SEA-LIONv3 Instruct.
|
39 |
|
40 |
For tokenisation, the model employs the default tokenizer used in Llama 3.1 70B Instruct. The model has a context length of 128k.
|
41 |
|