Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

73,744

Full-text search

Active filters: gguf

TheBloke/Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Dec 11, 2023 • 97k • 411

NeverSleep/Noromaid-13b-v0.3-GGUF

Updated Jan 7, 2024 • 516 • 15

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 404 • 17

xtuner/llava-llama-3-8b-v1_1-gguf

Image-to-Text • Updated Apr 30, 2024 • 6.38k • 202

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26, 2024 • 3.38k • 47

shenzhi-wang/Gemma-2-27B-Chinese-Chat

Text Generation • Updated Jul 4, 2024 • 1.35k • 63

ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1-GGUF

Updated Dec 3, 2024 • 1.69k • 18

QuantFactory/EZO-Common-9B-gemma-2-it-GGUF

Text Generation • Updated Jul 16, 2024 • 70 • 4

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 1, 2024 • 75.1k • 164

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 28, 2024 • 39.9k • 230

mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Updated Aug 3, 2024 • 12.7k • 129

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • Updated Jul 29, 2024 • 9.32k • 51

openbmb/MiniCPM-V-2_6-gguf

Updated Aug 13, 2024 • 5.62k • 149

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23, 2024 • 390k • 113

city96/FLUX.1-schnell-gguf

Text-to-Image • Updated Aug 18, 2024 • 25.8k • 191

bartowski/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Sep 15, 2024 • 17.2k • 59

second-state/3dAnimationDiffusion_v10-GGUF

Text-to-Image • Updated Aug 30, 2024 • 104 • 5

lm-kit/bge-m3-gguf

Updated Nov 6, 2024 • 2.87k • 4

Epiculous/Violet_Twilight-v0.2-GGUF

Text Generation • Updated Oct 13, 2024 • 58.9k • 32

Aratako/calm3-22b-RP-v2-GGUF

Updated Sep 16, 2024 • 134 • 3

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 20.3k • 27

gpustack/bge-reranker-v2-m3-GGUF

Text Classification • Updated Sep 29, 2024 • 1.79k • 4

openthaigpt/openthaigpt1.5-7b-instruct

Text Generation • Updated Nov 15, 2024 • 1.16k • 11

QuantFactory/Llama-3-8B-Instruct-Finance-RAG-GGUF

Text Generation • Updated Oct 20, 2024 • 2.36k • 32

RefalMachine/ruadapt_qwen2.5_3B_ext_u48_instruct_v4_gguf

Text Generation • Updated 12 days ago • 383 • 9

city96/stable-diffusion-3.5-large-turbo-gguf

Text-to-Image • Updated Oct 23, 2024 • 6.34k • 39

gpustack/jina-reranker-v2-base-multilingual-GGUF

Text Classification • Updated Oct 28, 2024 • 913 • 3

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 10, 2024 • 36.8k • 48

SporkySporkness/FLUX.1-Fill-dev-GGUF

Updated Nov 22, 2024 • 5.06k • 36

bartowski/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 27, 2024 • 43.2k • 93