tiiuae
/

Falcon3-10B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wdevazelhes commited on 1 day ago

Commit

9637b77

•

1 Parent(s): 77d052e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ Falcon3-10B-Instruct supports 4 languages (English, French, Spanish, Portuguese)
   - Uses SwiGLu and RMSNorm
   - 32K context length
   - 131K vocab size
-- Depth up-scaled from **Falcon3-7B-Base** with 2 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
 - Posttrained on 1.2 million samples of STEM, conversational, code, safety and function call data
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)

   - Uses SwiGLu and RMSNorm
   - 32K context length
   - 131K vocab size
+- Depth up-scaled from **Falcon3-7B-Base** with 2 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
 - Posttrained on 1.2 million samples of STEM, conversational, code, safety and function call data
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)