Update README.md

README.md

@@ -19,6 +19,33 @@ library_name: transformers
 This model was converted to GGUF format from [`tiiuae/Falcon3-7B-Instruct`](https://huggingface.co/tiiuae/Falcon3-7B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/tiiuae/Falcon3-7B-Instruct) for more details on the model.
 
+---
+Model details:
+-
+Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
+
+This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
+
+Model Details
+
+    Architecture
+    
+        Transformer based causal decoder only architecture
+        28 decoder blocks
+        Grouped query attention (GQA) for faster inference: 12 query heads and 4 key value heads
+        Wider head dimension: 256
+        High RoPE value to support long context understanding: 1000042
+        Uses SwiGLU and RMSNorm
+        32K context length
+        131K vocab size
+    Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
+    Postrained on 1.2 million samples of STEM, conversations, code, safety and function call data
+    Supports EN, FR, ES, PT
+    Developed by Technology Innovation Institute
+    License: TII Falcon-LLM License 2.0
+    Model Release Date: December 2024
+
+---
 ## Use with llama.cpp
 Install llama.cpp through brew (works on Mac and Linux)