Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,539

Full-text search

Active filters: 4-bit

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 268 • 9

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 73 • 16

madroid/flux.1-dev-mflux-4bit

Text-to-Image • Updated Sep 2, 2024 • 87 • 10

madroid/flux.1-schnell-mflux-4bit

Text-to-Image • Updated Sep 2, 2024 • 106 • 5

unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 2.04k • 5

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 1.41k • 7

unsloth/c4ai-command-r-plus-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 90 • 3

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 18 • 1

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 835 • 6

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 2.34M • 6

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 1.78M • 3

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11, 2024 • 262 • 3

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 2.33M • 24

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14, 2024 • 18 • 9

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 16.5k • 48

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 24, 2024 • 57.2k • 27

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19, 2024 • 2.56k • 6

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 2.33k • 1

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 49.3k • 2

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 69.3k • 16

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 9.79k • 34

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 5.21k • 9

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.98k • 5

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 15k • 9

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 33k • 20

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 23.8k • 17

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 51.5k • 64

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 246k • 60

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated Nov 22, 2024 • 3.06k • 3

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 2.33M • 5