TheBloke
/

sonya-medium-x8-MoE-GGUF

Model card Files Files and versions Community

sonya-medium-x8-MoE-GGUF

1 contributor

History: 3 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit c75ca5d)

b4f19cf 11 months ago

.gitattributes

1.65 kB

GGUF model commit (made with llama.cpp commit c75ca5d) 11 months ago
sonya-medium-x8-moe.Q2_K.gguf

23.4 GB
LFS

GGUF model commit (made with llama.cpp commit c75ca5d) 11 months ago
sonya-medium-x8-moe.Q3_K_M.gguf

30.5 GB
LFS

GGUF model commit (made with llama.cpp commit c75ca5d) 11 months ago