ikawrakow
/

mixtral-8x7b-quantized-gguf

Model card Files Files and versions

mixtral-8x7b-quantized-gguf

145 GB

1 contributor

History: 3 commits

ikawrakow's picture

Update README.md

558135c about 2 years ago

.gitattributes

1.56 kB

Adding Mixtral quantized models about 2 years ago
README.md

1.53 kB

Update README.md about 2 years ago
mixtral-8x7b-q2k.gguf

15.4 GB
xet

Adding Mixtral quantized models about 2 years ago
mixtral-8x7b-q3k-medium.gguf

22.4 GB
xet

Adding Mixtral quantized models about 2 years ago
mixtral-8x7b-q3k-small.gguf

20.3 GB
xet

Adding Mixtral quantized models about 2 years ago
mixtral-8x7b-q4k-medium.gguf

28.4 GB
xet

Adding Mixtral quantized models about 2 years ago
mixtral-8x7b-q4k-small.gguf

26.7 GB
xet

Adding Mixtral quantized models about 2 years ago
mixtral-8x7b-q5k-small.gguf

32.2 GB
xet

Adding Mixtral quantized models about 2 years ago