Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

35

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-70B

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated 4 days ago • 12.9k • 23

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 2 days ago • 8.97k • 14

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 2 days ago • 7.43k • 6

mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit

Updated 4 days ago • 221 • 3

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 4 days ago • 1.37k • 2

mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF

Updated about 19 hours ago • 1.04k • 2

WaveCut/deepseek-ai_DeepSeek-R1-Distill-Llama-70B_MLX-4bit

Updated 4 days ago • 71 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated 4 days ago • 283 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated 3 days ago • 66 • 1

mradermacher/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated about 19 hours ago • 331 • 1

mlx-community/DeepSeek-R1-Distill-Llama-70B-6bit

Text Generation • Updated 3 days ago • 58 • 1

lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 4 days ago • 2.15k

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

Text Generation • Updated 4 days ago • 64

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

Text Generation • Updated 4 days ago • 47

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated 4 days ago • 67

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

Text Generation • Updated 4 days ago • 48

mmnga/DeepSeek-R1-Distill-Llama-70B-gguf

Updated 3 days ago • 1.18k

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF

Text Generation • Updated 4 days ago • 56

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q5_0-GGUF

Text Generation • Updated 4 days ago • 65

XelotX/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated 4 days ago • 243

zhitels/DeepSeek-R1-Distill-Llama-70B-4bit

Updated 4 days ago • 90

zhitels/DeepSeek-R1-Distill-Llama-70B-6bit

Updated 4 days ago • 21

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q8_0-GGUF

Text Generation • Updated 3 days ago • 80

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q4f16_1-MLC

Updated 3 days ago • 4

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q0f16-MLC

Updated 3 days ago • 6

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q4f32_1-MLC

Updated 3 days ago • 6

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated 3 days ago • 146

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated 3 days ago • 52

second-state/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 2 days ago • 263

gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 2 days ago • 104