Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,842

Full-text search

Active filters: chat

v8karlo/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 2, 2024 • 9

Sakalti/llmjp

Text Generation • Updated Oct 3, 2024 • 69

QuantFactory/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 3, 2024 • 145 • 1

ValiantLabs/Llama3.2-3B-Esper2

Text Generation • Updated Jan 21 • 53 • 3

mav23/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 36

mav23/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 143

mav23/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 136

redhat6/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 14

turingevo/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 9

turingevo/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 9

mradermacher/Llama3.1-8B-PlumMath-GGUF

Updated Oct 11, 2024 • 285

mradermacher/Llama3.1-8B-PlumChat-GGUF

Updated Nov 18, 2024 • 16

mradermacher/Llama3.1-8B-PlumCode-GGUF

Updated Nov 18, 2024 • 131

mradermacher/Llama3.1-8B-PlumMath-i1-GGUF

Updated Oct 11, 2024 • 215

mradermacher/Llama3.1-8B-PlumChat-i1-GGUF

Updated Nov 18, 2024 • 30

mradermacher/Llama3.1-8B-PlumCode-i1-GGUF

Updated Nov 18, 2024 • 806

mlx-community/Dracarys2-72B-Instruct-8bit

Text Generation • Updated Oct 6, 2024 • 10 • 1

huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated

Text Generation • Updated Nov 25, 2024 • 101 • 6

mlx-community/Dracarys2-72B-Instruct-4bit

Text Generation • Updated Oct 6, 2024 • 10

mav23/Dracarys2-72B-Instruct-GGUF

Text Generation • Updated Oct 7, 2024 • 141

mradermacher/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Updated Oct 11, 2024 • 242 • 2

Sakalti/Qwen7b

Text Generation • Updated Oct 9, 2024 • 6

mradermacher/Qwen2.5-Coder-7B-Instruct-abliterated-i1-GGUF

Updated Oct 11, 2024 • 358 • 2

mav23/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Oct 7, 2024 • 170

gghfez/zetasepic_Qwen2.5-72B-Instruct-abliterated-exl2-4.5bpw

Text Generation • Updated Oct 7, 2024 • 8 • 3

anthracite-org/magnum-v4-22b-exl2

Text Generation • Updated Nov 25, 2024 • 18 • 5

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • Updated Oct 8, 2024 • 175 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • Updated Oct 8, 2024 • 21.6k • 3

Jeethu/Qwen2.5-1.5B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024 • 19

Jeethu/Qwen2.5-3B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024 • 16