ehristoforu
/

Falcon3-MoE-2x7B-Insruct

Text Generation

Mixture of Experts

Model card Files Files and versions Community

ehristoforu commited on Dec 22, 2024

Commit

93fd920

·

verified ·

1 Parent(s): 83a9dcf

Update README.md

Files changed (1) hide show

README.md +6 -0

README.md CHANGED Viewed

	@@ -15,3 +15,9 @@ tags:
15
16	# Falcon3 MoE 2x7B Instruct
17

 # Falcon3 MoE 2x7B Instruct
+Mixture of Experts of Falcon3 7B-IT & 7B-IT.
+- 13.4B parameters
+- BF16
+- Falcon3 (Llama)
+- Instruct