mmnga
/

Mixtral-Fusion-4x7B-Instruct-v0.1

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

mmnga commited on Dec 16, 2023

Commit

b707346

•

1 Parent(s): 6f4637c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ language:
 inference: false
 ---
 # Model Card for Mixtral-Fusion-4x7B-Instruct-v0.1
-This model is an experimental model created by merging mixtral 8x7b experts.
 # How we merged experts
 We simply take the average of every two experts.weight.

 inference: false
 ---
 # Model Card for Mixtral-Fusion-4x7B-Instruct-v0.1
+This model is an experimental model created by merging [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) experts.
 # How we merged experts
 We simply take the average of every two experts.weight.