Jian-Gang commited on
Commit
014a257
·
verified ·
1 Parent(s): 3f583c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -23,7 +23,7 @@ license: llama3.1
23
 
24
  SEA-LION is a collection of Large Language Models (LLMs) which have been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
25
 
26
- Llama3.1 70B CPT SEA-LIONv3 Instruct is a multilingual model that has been fine-tuned in two stages on approximately **12.3M English instruction-completion pairs** alongside a pool of **4.5M Southeast Asian instruction-completion pairs** from SEA languages such as Indonesian, Tamil, Thai, and Vietnamese.
27
 
28
  SEA-LION stands for _Southeast Asian Languages In One Network_.
29
 
@@ -35,7 +35,7 @@ SEA-LION stands for _Southeast Asian Languages In One Network_.
35
 
36
  ## Model Details
37
  ### Model Description
38
- We performed instruction tuning in English and also in SEA languages such as Indonesian, Tamil, Thai and Vietnamese on our [continued pre-trained Llama3.1 70B CPT SEA-LIONv3 Base](https://huggingface.co/aisingapore/llama3.1-70B-cpt-sea-lionv3-base), a decoder model using the Llama 3.1 architecture, to create Llama3.1 70B CPT SEA-LIONv3 Instruct.
39
 
40
  For tokenisation, the model employs the default tokenizer used in Llama 3.1 70B Instruct. The model has a context length of 128k.
41
 
 
23
 
24
  SEA-LION is a collection of Large Language Models (LLMs) which have been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
25
 
26
+ Llama3.1 70B CPT SEA-LIONv3 Instruct is a multilingual model that has been fine-tuned in two stages on approximately **12.3M English instruction-completion pairs** alongside a pool of **4.5M Southeast Asian instruction-completion pairs** from SEA languages such as Indonesian, Javanese, Sundanese, Tamil, Thai, and Vietnamese.
27
 
28
  SEA-LION stands for _Southeast Asian Languages In One Network_.
29
 
 
35
 
36
  ## Model Details
37
  ### Model Description
38
+ We performed instruction tuning in English and also in SEA languages such as Indonesian, Javanese, Sundanese, Tamil, Thai and Vietnamese on our [continued pre-trained Llama3.1 70B CPT SEA-LIONv3 Base](https://huggingface.co/aisingapore/llama3.1-70B-cpt-sea-lionv3-base), a decoder model using the Llama 3.1 architecture, to create Llama3.1 70B CPT SEA-LIONv3 Instruct.
39
 
40
  For tokenisation, the model employs the default tokenizer used in Llama 3.1 70B Instruct. The model has a context length of 128k.
41