Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

78,608

Full-text search

Active filters: gguf

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 10.7k • 132

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21, 2024 • 10.4k • 62

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.52M • 11

Qwen/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 18, 2024 • 11.5k • 20

mradermacher/L3-Aethora-15B-GGUF

Updated Jun 7, 2024 • 2.97k • 8

QuantFactory/deepseek-math-7b-instruct-GGUF

Text Generation • Updated Jun 10, 2024 • 8.05k • 6

kalomaze/Mistral-7b-MoEified-8x

Text Generation • Updated Jun 10, 2024 • 26 • 4

bartowski/L3-8B-Stheno-v3.2-GGUF

Text Generation • Updated Jun 12, 2024 • 1.82k • 14

llmware/slim-summary-tiny-tool

Updated Jun 21, 2024 • 23 • 2

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13, 2024 • 9 • 3

lmg-anon/vntl-llama3-8b-gguf

Translation • Updated Jun 15, 2024 • 285 • 8

mradermacher/nyun-c1-llama3-62B-GGUF

Updated Jun 17, 2024 • 123 • 1

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 27.5k • 93

lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 22, 2024 • 19.3k • 34

dohyung97022/markdownCreator

Updated Jun 18, 2024 • 10 • 2

IndexTeam/Index-1.9B-Chat-GGUF

Updated Jun 26, 2024 • 415 • 19

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.51M • 16

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 337 • 5

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.25k • 20

alibayram/Doktor-Llama-3-8b.gguf

Updated Jun 20, 2024 • 13 • 3

kyx0r/L3-Evil-Stheno-v3.2-8B-GGUF

Text Generation • Updated Jun 21, 2024 • 23 • 1

google/DiarizationLM-13b-Fisher-v1

Text Generation • Updated Aug 11, 2024 • 148 • 12

Aratako/Oumuamua-7b-RP-GGUF

Updated Jun 23, 2024 • 120 • 4

Lewdiculous/L3-8B-Stheno-v3.3-32K-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 554 • 35

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 740 • 16

mradermacher/Qwen2-7B-Multilingual-RP-GGUF

Updated Jun 25, 2024 • 5.48k • 18

LWDCLS/KobbleTinyV2-1.1B-GGUF-IQ-Imatrix-Request

Updated Jun 24, 2024 • 38 • 3

mradermacher/dolphin-2.9.3-mistral-7B-32k-GGUF

Updated Jun 25, 2024 • 395 • 5

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 275 • 1

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-X-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 180 • 3