Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

848

Full-text search

Active filters: imatrix

bartowski/NemoReRemix-12B-GGUF

Text Generation • Updated Aug 14 • 528 • 7

bartowski/Peach-9B-8k-Roleplay-GGUF

Text Generation • Updated Aug 15 • 794 • 3

mradermacher/mistral-nemo-gutenberg-12B-v3-i1-GGUF

Updated Aug 16 • 433 • 2

bartowski/Hermes-3-Llama-3.1-8B-lorablated-GGUF

Text Generation • Updated Aug 16 • 1.82k • 7

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.04M • 7

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.83M • 5

mradermacher/magnum-v2-72b-i1-GGUF

Updated Sep 8 • 562 • 4

mradermacher/Chronos-Gold-12B-1.0-i1-GGUF

Updated Sep 16 • 20.7k • 8

bartowski/functionary-medium-v3.2-GGUF

Text Generation • Updated Aug 22 • 486 • 2

bartowski/falcon-mamba-7b-GGUF

Text Generation • Updated Aug 22 • 2.6k • 7

mradermacher/MemGPT-Nemo-i1-GGUF

Updated Aug 23 • 124 • 1

mradermacher/NemoMix-Unleashed-12B-i1-GGUF

Updated about 1 month ago • 1.41k • 8

mradermacher/Grand-Horror-25B-Godzillas-Wicked-Sister-i1-GGUF

Updated 25 days ago • 238 • 1

bartowski/Trinity-2-Codestral-22B-v0.2-GGUF

Text Generation • Updated Aug 27 • 952 • 4

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30 • 3.06k • 16

bartowski/Llama-3.1-8B-Ultra-Instruct-GGUF

Text Generation • Updated Sep 3 • 2.14k • 1

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 1.83M • 2

bartowski/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 5 • 2.63k • 16

mradermacher/New-Dawn-Ultra-Llama-3-70B-32K-v1.0-i1-GGUF

Updated Sep 6 • 688 • 2

mradermacher/Yi-1.5-9B-Chat-abliterated-i1-GGUF

Updated Sep 6 • 422 • 1

mradermacher/L3.1-DarkStock-8B-i1-GGUF

Updated Sep 7 • 349 • 2

bartowski/MN-12B-Lyra-v4-GGUF

Text Generation • Updated Sep 9 • 777 • 4

mradermacher/CodeLlama-70b-Python-hf-i1-GGUF

Updated Sep 11 • 446 • 1

bartowski/DeepSeek-Coder-V2-Instruct-0724-GGUF

Text Generation • Updated Sep 11 • 390 • 1

mradermacher/DeepSeek-V2.5-i1-GGUF

Updated Sep 12 • 340 • 2

bartowski/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 16 • 668 • 12

bartowski/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11 • 158 • 2

mradermacher/Chronos-Divergence-33B-i1-GGUF

Updated Sep 12 • 221 • 1

mradermacher/Lyra4-Gutenberg-12B-i1-GGUF

Updated about 1 month ago • 566 • 2

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.86M • 18