1 contributor

History: 33 commits

TheBloke

Upload new k-quant GGML quantised models.

c99263d over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

9.94 kB

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q2_K.bin

5.43 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q3_K_L.bin

6.87 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q3_K_M.bin

6.25 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q3_K_S.bin

5.59 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q4_0.bin

7.32 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-13B.ggmlv3.q4_1.bin

8.14 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-13B.ggmlv3.q4_K_M.bin

7.82 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q4_K_S.bin

7.32 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q5_0.bin

8.95 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-13B.ggmlv3.q5_1.bin

9.76 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-13B.ggmlv3.q5_K_M.bin

9.21 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q5_K_S.bin

8.95 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q6_K.bin

10.7 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
koala-13B.ggmlv3.q8_0.bin

13.8 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago