Triangle104
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -109,6 +109,32 @@ model-index:
|
|
109 |
This model was converted to GGUF format from [`tiiuae/Falcon3-10B-Instruct`](https://huggingface.co/tiiuae/Falcon3-10B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
110 |
Refer to the [original model card](https://huggingface.co/tiiuae/Falcon3-10B-Instruct) for more details on the model.
|
111 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
112 |
## Use with llama.cpp
|
113 |
Install llama.cpp through brew (works on Mac and Linux)
|
114 |
|
|
|
109 |
This model was converted to GGUF format from [`tiiuae/Falcon3-10B-Instruct`](https://huggingface.co/tiiuae/Falcon3-10B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
110 |
Refer to the [original model card](https://huggingface.co/tiiuae/Falcon3-10B-Instruct) for more details on the model.
|
111 |
|
112 |
+
---
|
113 |
+
Model details:
|
114 |
+
-
|
115 |
+
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.
|
116 |
+
|
117 |
+
This repository contains the Falcon3-10B-Instruct. It achieves state-of-the-art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-10B-Instruct supports 4 languages (English, French, Spanish, Portuguese) and a context length of up to 32K.
|
118 |
+
|
119 |
+
Details
|
120 |
+
-
|
121 |
+
Architecture
|
122 |
+
Transformer-based causal decoder-only architecture
|
123 |
+
40 decoder blocks
|
124 |
+
Grouped Query Attention (GQA) for faster inference: 12 query heads and 4 key-value heads
|
125 |
+
Wider head dimension: 256
|
126 |
+
High RoPE value to support long context understanding: 1000042
|
127 |
+
Uses SwiGLu and RMSNorm
|
128 |
+
32K context length
|
129 |
+
131K vocab size
|
130 |
+
Depth up-scaled from Falcon3-7B-Base with 2 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
|
131 |
+
Posttrained on 1.2 million samples of STEM, conversational, code, safety and function call data
|
132 |
+
Supports EN, FR, ES, PT
|
133 |
+
Developed by Technology Innovation Institute
|
134 |
+
License: TII Falcon-LLM License 2.0
|
135 |
+
Model Release Date: December 2024
|
136 |
+
|
137 |
+
---
|
138 |
## Use with llama.cpp
|
139 |
Install llama.cpp through brew (works on Mac and Linux)
|
140 |
|