File size: 338 Bytes
b3362b1
 
 
8aafe44
2484d36
8aafe44
d8fe6d6
 
2484d36
 
 
1
2
3
4
5
6
7
8
9
10
11
---
base_model:
- deepseek-ai/DeepSeek-V3
---
Initial preview for the GGUF quantized version of [deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)

It needs this PR commit to work: https://github.com/ggerganov/llama.cpp/pull/11049

Thanks to Fairydreaming for the PR! 

Note: no multi-token prediction (MTP) support