SmartSolMix-4x10.7b-v1

An experimental MOE of various 10.7b models made with mergekit

Experts

TBD

Should work with chatml as well as alpaca style prompt templates

Safetensors

Model size

36.1B params

Tensor type

FP16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Quantizations