Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,473

Full-text search

Active filters: 6-bit

blockblockblock/SauerkrautLM-Qwen-32b-bpw6

Text Generation • Updated Apr 15 • 7

bdambrosio/WizardLM-2-8x22B-6.0bpw-h8-exl2

Text Generation • Updated Apr 16 • 16

Dracones/WizardLM-2-8x22B_exl2_6.0bpw

Text Generation • Updated Apr 16 • 15

Dracones/CodeQwen1.5-7B-Chat_exl2_6.0bpw

Text Generation • Updated Apr 16 • 8

Dracones/CodeQwen1.5-7B_exl2_6.0bpw

Text Generation • Updated Apr 16 • 5

Skylaude/WizardLM-2-4x7B-MoE-exl2-6_0bpw

Text Generation • Updated Apr 16 • 7

blockblockblock/deepseek-math-7b-rl-bpw6

Text Generation • Updated Apr 17 • 2

DZgas/GIGABATEMAN-7B-GGUF

Text Generation • Updated Sep 15 • 184 • 6

impactframes/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 155 • 1

Kotokin/Meta-Llama-3-8B-hf-exl2-6bpw

Text Generation • Updated Apr 18 • 4

LoneStriker/Meta-Llama-3-8B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Apr 23 • 7 • 1

LoneStriker/Meta-Llama-3-8B-6.0bpw-h6-exl2

Text Generation • Updated Apr 23 • 6

LoneStriker/Meta-Llama-3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Apr 23 • 6 • 3

blockblockblock/DolphinHermesPro-ModelStock-bpw6

Text Generation • Updated Apr 19 • 4

lucyknada/dreamgen-opus-v1.2-llama-3-8b-instruct-6bpw

Text Generation • Updated Apr 20 • 5

LoneStriker/Meta-Llama-3-70B-6.0bpw-h6-exl2

Text Generation • Updated Apr 23 • 3 • 1

MaziyarPanahi/Llama-3-11B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 20 • 743 • 7

MaziyarPanahi/Llama-3-13B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 20 • 886 • 5

MaziyarPanahi/Llama-3-16B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 20 • 440 • 8

LoneStriker/opus-v1.2-llama-3-8b-6.0bpw-h6-exl2

Text Generation • Updated Apr 19 • 12 • 1

MarsupialAI/HelloNurse-11b_6.0bpw_exl2

Text Generation • Updated Apr 20 • 2

MaziyarPanahi/Llama-3-Smaug-8B-GGUF

Text Generation • Updated Apr 20 • 1.57M • 4

LoneStriker/Llama-3-Smaug-8B-6.0bpw-h6-exl2

Text Generation • Updated Apr 20 • 9 • 2

blockblockblock/Copus-2x8B-bpw6

Text Generation • Updated Apr 20 • 3

Natkituwu/Poppy_Porpoise-v0.2-L3-8B-6.0bpw-exl2

Text Generation • Updated Apr 20 • 5

lucyknada/ResplendentAI_Aura_Uncensored_l3_8B-6.0bpw-EXL2

Text Generation • Updated Apr 21 • 7 • 2

Slvcxc/saiga_llama3_8b-V2-6.0bpw-h6-exl2

Text Generation • Updated Apr 30 • 16

LoneStriker/OrpoLlama-3-8B-6.0bpw-h6-exl2

Text Generation • Updated Apr 21 • 5

LoneStriker/dolphin-2.9-llama3-8b-6.0bpw-h6-exl2

Text Generation • Updated Apr 21 • 5 • 2

Slvcxc/L3-Solana-8B-v1-6.0bpw-h6-exl2

Text Generation • Updated Apr 21 • 5