Updated Dynamic DeepSeek-V3.1 GGUFs - even better performance than before! 🐋
#9
pinned
by
shimmyshimmer
- opened
Hey guys, we reuploaded the DeepSeek-V3.1 quants and according to 3rd party Aider polyglot benchmarks, they're even better than before.
The benchmarks are 90% done already and we compared them other quants and our previous quants and the results are clearly an improvement. Thanks to neonilithic for doing the benchmarks!
We converted DeepSeek-V3.1 using our normal conversion, however we needed to update it as we didn't know llama.cpp overrode some of our layer quantization for conversion so we needed to change reupload them. The quants should only be a few MB bigger but the increase in accuracy is very large.
We'll announce the amazing results likely next week, yes you will need to redownload.
shimmyshimmer
pinned discussion
That'a boy Mikey! 😋👏 🦥