mradermacher
/

Mixtral-8x7B-Instruct-v0.1-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-i1-GGUF

1 contributor

History: 3 commits

mradermacher's picture

uploaded from kaos

563a3d9 verified 9 months ago

.gitattributes

2.5 kB

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-IQ1_S.gguf

9.71 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-IQ2_XS.gguf

13.8 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-IQ2_XXS.gguf

12.5 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-IQ3_XXS.gguf

18.5 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q2_K.gguf

17.5 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q3_K_L.gguf

24.3 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q3_K_M.gguf

22.7 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q3_K_S.gguf

20.6 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q3_K_XS.gguf

19.2 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q4_K_M.gguf

28.6 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q4_K_S.gguf

26.9 GB
LFS

uploaded from kaos 9 months ago
Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_M.gguf

33.4 GB
LFS

uploaded from kaos 9 months ago
README.md

86 Bytes

Create README.md 9 months ago
imatrix.dat

25.7 MB
LFS

uploaded from kaos 9 months ago