mmnga
/

Mixtral-Fusion-4x7B-Instruct-v0.1

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (1)

Maybe a slerp or some other merge method will preserve the component experts better?

#2 opened 11 months ago by

Responses somewhat related to the prompt but still gibberish

#1 opened 11 months ago by