erikqu
/

Mixtral_7Bx4_MOE_24B-gguf

GGUF

Inference Endpoints

Model card Files Files and versions Community

Original repo: https://huggingface.co/cloudyu/Mixtral_7Bx4_MOE_24B

This is the Q4_K_M version.

Model requires ~13G vram.

Downloads last month: 0

GGUF

Model size

24.2B params

Architecture

llama

4-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.