unsloth
/

DeepSeek-V3-GGUF

Inference Endpoints

Model card Files Files and versions Community

danielhanchen commited on 2 days ago

Commit

c7c1171

·

verified ·

1 Parent(s): 5fba0b8

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -33,6 +33,7 @@ tags:
    ./llama.cpp/llama-cli
    --model unsloth/DeepSeek-V3-GGUF/DeepSeek-V3-Q2_K_XS/DeepSeek-V3-Q2_K_XS-00001-of-00005.gguf
    --cache-type-k q5_0
    --prompt '<｜User｜>What is 1+1?<｜Assistant｜>'
    ```
    Example output:

    ./llama.cpp/llama-cli
    --model unsloth/DeepSeek-V3-GGUF/DeepSeek-V3-Q2_K_XS/DeepSeek-V3-Q2_K_XS-00001-of-00005.gguf
    --cache-type-k q5_0
+   --threads 16
    --prompt '<｜User｜>What is 1+1?<｜Assistant｜>'
    ```
    Example output: