Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4,228

Full-text search

Active filters: pt

baseten/Meta-Llama-3.1-Instruct-tokenizer

Text Generation • Updated Aug 9 • 1

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 2.82k • 12

anthracite-org/magnum-v2.5-12b-kto

Text Generation • Updated Aug 22 • 2.96k • 40

anthracite-org/magnum-v2.5-12b-kto-exl2

Text Generation • Updated Aug 15 • 18 • 9

akjindal53244/Llama-3.1-Storm-8B

Text Generation • Updated Aug 29 • 13.3k • 164

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 2 • 1.09k • 8

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 14 • 18 • 1

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • Updated Aug 22 • 5.1k • 33

natong19/Mistral-Nemo-Instruct-2407-abliterated

Updated Aug 15 • 2.49k • 6

akjindal53244/Llama-3.1-Storm-8B-GGUF

Text Generation • Updated Aug 21 • 1.7k • 41

SIRIS-Lab/affilgood-span-multilingual

Updated 18 days ago • 16 • 1

jinaai/jina-colbert-v2

Updated 22 days ago • 51.4k • 83

anthracite-org/magnum-v2-123b

Text Generation • Updated Sep 12 • 404 • 56

ghost-x/ghost-8b-beta-1608

Text Generation • Updated Aug 23 • 6.03k • 29

anthracite-org/magnum-v2-123b-gguf

Text Generation • Updated Aug 22 • 702 • 12

anthracite-org/magnum-v2-123b-exl2

Text Generation • Updated Aug 19 • 42 • 3

anthracite-org/magnum-v2-72b-exl2

Text Generation • Updated Aug 22 • 34 • 3

ai21labs/AI21-Jamba-1.5-Mini

Text Generation • Updated Sep 17 • 5.7k • 239

ai21labs/AI21-Jamba-1.5-Large

Text Generation • Updated Sep 17 • 2.9k • 198

Mozilla/Meta-Llama-3.1-70B-Instruct-llamafile

Updated Aug 20 • 1.07k • 7

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 873 • 2

bartowski/Llama-3.1-Storm-8B-GGUF

Text Generation • Updated Aug 20 • 1.03k • 6

mradermacher/Llama-3.1-Storm-8B-GGUF

Updated Aug 20 • 392 • 2

mradermacher/magnum-v2-123b-GGUF

Updated Sep 8 • 27 • 5

mradermacher/magnum-v2-123b-i1-GGUF

Updated Sep 8 • 191 • 6

Epiculous/Azure_Dusk-v0.1-GGUF

Text Generation • Updated Aug 24 • 207 • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_2.5bpw_h6

Text Generation • Updated Aug 21 • 6 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21 • 12 • 1

mradermacher/magnum-v2-72b-i1-GGUF

Updated Sep 8 • 418 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23 • 56 • 2