Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,472

Full-text search

Active filters: 6-bit

blockblockblock/TableLLM-13b-bpw6

Text Generation • Updated Apr 4 • 6

blockblockblock/Young-Children-Storyteller-Mistral-7B-bpw6

Text Generation • Updated Apr 5 • 11

Dracones/Merged-RP-Stew-V2-34B_exl2_6.0bpw

Text Generation • Updated Apr 11 • 6

LoneStriker/gemma-1.1-7b-it-6.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 5

LoneStriker/Qwen1.5-32B-Chat-6.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 3

LoneStriker/Qwen1.5-32B-6.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 3

atcsecure/frankenmoe-8x7b-exl2_6_0

Text Generation • Updated Apr 8 • 4

MaziyarPanahi/Calme-12B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 7 • 194 • 2

blockblockblock/MiquMaid-v3-70B-bpw6

Text Generation • Updated Apr 8 • 14

llmixer/command-r-plus-6.0bpw-h8-exl2

Text Generation • Updated Apr 8 • 9 • 1

MaziyarPanahi/codegemma-2b-GGUF

Text Generation • Updated Apr 9 • 204

MaziyarPanahi/codegemma-7b-it-GGUF

Text Generation • Updated Apr 9 • 229

MaziyarPanahi/codegemma-7b-GGUF

Text Generation • Updated Apr 9 • 257

MaziyarPanahi/gemma-1.1-2b-it-GGUF

Text Generation • Updated Apr 9 • 302

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 47.2k • 73

blockblockblock/QueenLiz-120B-bpw6

Text Generation • Updated Apr 10 • 1

blockblockblock/Faro-Yi-9B-bpw6

Text Generation • Updated Apr 11 • 3

Dracones/c4ai-command-r-v01_exl2_6.0bpw

Text Generation • Updated Apr 12 • 11 • 3

Dracones/c4ai-command-r-v01_exl2_6.0bpw-rpcal

Text Generation • Updated Apr 12 • 13

Dracones/miqu-1-70b-sf_exl2_6.0bpw

Text Generation • Updated Apr 11 • 9

ChristianAzinn/mixtral-8x22b-v0.1-imatrix

Text Generation • Updated Apr 12 • 173

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12 • 46.2k • 28

blockblockblock/SambaLingo-Hungarian-Chat-bpw6

Text Generation • Updated Apr 12 • 7

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw6

Text Generation • Updated Apr 11 • 3

blockblockblock/airoboros-34b-3.3-bpw6

Text Generation • Updated Apr 14 • 3

LoneStriker/bagel-7b-v0.5-6.0bpw-h6-exl2

Text Generation • Updated Apr 14 • 5

bdambrosio/Mixtral-8x22b-instruct-oh-6.0bpw-exl2

Text Generation • Updated Apr 14 • 9

Dracones/mixtral-8x22b-instruct-oh_exl2_6.0bpw

Text Generation • Updated Apr 14 • 3

bdambrosio/command-r-plus-6.0bpw-h8-exl2

Text Generation • Updated Apr 15 • 3

blockblockblock/SauerkrautLM-Qwen-32b-bpw6

Text Generation • Updated Apr 15 • 7