Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,515

Full-text search

Active filters: chat

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18 • 76 • 2

mlx-community/Qwen2.5-14B-Instruct-4bit

Text Generation • Updated Sep 18 • 2.91k • 2

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated 19 days ago • 763 • 3

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20 • 198 • 2

QuantFactory/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 19 days ago • 1.04k • 2

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 19 • 37 • 1

QuantFactory/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated 19 days ago • 2.63k • 5

mlx-community/Qwen2.5-72B-Instruct-8bit

Text Generation • Updated Sep 19 • 111 • 3

Qwen/Qwen2.5-Math-7B-Instruct

Text Generation • Updated Sep 23 • 90.7k • 38

LoneStriker/Qwen2.5-72B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 24 • 1

LoneStriker/Qwen2.5-72B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 18 • 4

MaziyarPanahi/calme-2.2-qwen2.5-72b

Text Generation • Updated Sep 29 • 2.83k • 6

ThomasBaruzier/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 23 • 852 • 1

anthracite-org/magnum-v4-72b

Text Generation • Updated Oct 19 • 981 • 21

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 7 days ago • 661 • 1

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated 7 days ago • 718 • 2

v000000/Qwen2.5-Lumen-14B

Text Generation • Updated Oct 3 • 2.73k • 15

QuantFactory/Qwen2.5-Lumen-14B-GGUF

Text Generation • Updated Sep 21 • 278 • 3

mradermacher/Qwen2.5-Lumen-14B-GGUF

Updated Sep 22 • 483 • 4

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

Updated Sep 22 • 672 • 7

mradermacher/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Updated Sep 24 • 1.25k • 8

byroneverson/Mistral-Small-Instruct-2409-abliterated

Text Generation • Updated Sep 24 • 121 • 10

mradermacher/Mistral-Small-Instruct-2409-abliterated-GGUF

Updated Sep 24 • 1.25k • 2

mradermacher/Qwen2.5-7B-Instruct-abliterated-v2-i1-GGUF

Updated Sep 24 • 342 • 3

anthracite-org/magnum-v4-72b-exl2

Text Generation • Updated Oct 19 • 158 • 4

mradermacher/Qwen2.5-14B-Instruct-abliterated-GGUF

Updated Sep 26 • 270 • 6

bartowski/Qwen2.5-Coder-7B-Instruct-exl2

Text Generation • Updated Sep 29 • 102 • 5

anthracite-org/magnum-v4-72b-gguf

Text Generation • Updated Oct 20 • 35.6k • 6

ValiantLabs/Llama3.2-3B-ShiningValiant2

Text Generation • Updated 20 days ago • 445 • 3

anthracite-org/magnum-v4-9b-gguf

Text Generation • Updated Oct 20 • 1.97k • 13