| base_model: | |
| - deepseek-ai/DeepSeek-V3 | |
| Initial preview for the GGUF quantized version of [deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3) | |
| It needs this PR commit to work: https://github.com/ggerganov/llama.cpp/pull/11049 | |
| Thanks to Fairydreaming for the PR! | |
| Note: no multi-token prediction (MTP) support |