mesolitica
/

mallam-5B-4096

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

huseinzol05 commited on Dec 28, 2023

Commit

c28553d

•

1 Parent(s): c89a70f

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -3,7 +3,9 @@ language:
 - ms
 ---
-# MaLLaM 🌙 5B (Malaysia Large Language Model), Pretrain 5B 4096 context length Mistral on Malaysian text
 README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral

 - ms
 ---
+# MaLLaM 🌙 5B (Malaysia Large Language Model), Pretrain 5B 4096 context length on Malaysian text
+Pretrain from scratch 5B parameters using Mistral architecture on 90B Malaysian text tokens.
 README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral