Jezzarax
/

yi-6B-GGUF

Model card Files Files and versions Community

2 contributors

History: 3 commits

Jezzarax's picture

Make readme visible; Fix quantisation table

cfe8e30 about 1 year ago

.gitattributes

2.05 kB

Initial commit with draft readme and quantized models about 1 year ago
README.md

17 kB

Make readme visible; Fix quantisation table about 1 year ago
config.json

27 Bytes

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q2_K.gguf

2.62 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q3_K.gguf

2.99 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q3_K_L.gguf

3.24 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q3_K_S.gguf

2.71 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q4_K.gguf

3.67 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q4_K_S.gguf

3.5 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q5_K.gguf

4.3 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q5_K_S.gguf

4.2 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.Q6_K.gguf

4.97 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago
yi-6b.f16.gguf

12.1 GB
LFS

Initial commit with draft readme and quantized models about 1 year ago