Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

104

Full-text search

Active filters: autoquant

Volko76/Qwen2.5-0.5B-Instruct-4.5bpw-exl2

Text Generation • Updated 10 days ago

Volko76/Qwen2.5-0.5B-Instruct-EXL2-4bits

Text Generation • Updated 10 days ago

Volko76/Qwen2.5-Coder-1.5B-Instruct-5.5bpw-exl2

Text Generation • Updated 10 days ago

HoneyBadger2989/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated 8 days ago • 191

jgchaparro/Tyros-v1.6-8B-GGUF

Updated 4 days ago • 107

Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 2 days ago • 140

Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2

Text Generation • Updated 1 day ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2

Text Generation • Updated 1 day ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-2.0bpw-exl2

Text Generation • Updated 1 day ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-3.0bpw-exl2

Text Generation • Updated 1 day ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-8.0bpw-exl2

Text Generation • Updated 1 day ago

Volko76/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 159

Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 1 day ago • 114

pav-stackera/llama3-8b-instruct-text-to-sql-final-GGUF

Text Generation • Updated about 15 hours ago • 2