Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

13,517

Full-text search

Active filters: gguf-my-repo

ozone-ai/0x-lite-Q4_K_M-GGUF

Updated 22 days ago • 1.03k • 15

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3, 2024 • 863 • 62

openerotica/writing-roleplay-20k-context-nemo-12b-v1.0-gguf

Updated Oct 16, 2024 • 3.57k • 21

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated Jan 8 • 23 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated Jan 8 • 16 • 7

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated Nov 5, 2024 • 1.55k • 36

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated Jan 8 • 16 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 32 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 21 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated Jan 8 • 14 • 7

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated 25 days ago • 72 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated 18 days ago • 63 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated 17 days ago • 483 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated 17 days ago • 140 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated 16 days ago • 1.4k • 2

ari04s/Bio-Medical-Llama-3-8B-CoT-012025-Q8_0-GGUF

Updated 6 days ago • 2.86k • 2

itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF

Updated 5 days ago • 29 • 2

Cran-May/CohenQu-DeepSeek-R1-Distill-Qwen-1.5B-GRPO-duplicate-fixed-6140715-Q5_K_M-GGUF

Updated 4 days ago • 134 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 958 • 3

NikolayKozloff/csmpt7b-Czech-GGUF

Updated Apr 6, 2024 • 36 • 4

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10, 2024 • 70 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 1.09k • 21

DavidAU/Rosa_v1_3B-Q6_K-GGUF

Updated Apr 12, 2024 • 12 • 2

DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF

Text Generation • Updated Apr 21, 2024 • 412 • 4

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 33 • 1

hus960/openbuddy-mistral2-7b-v20.3-32k-Q4_K_M-GGUF

Text Generation • Updated Apr 23, 2024 • 8 • 1

DavidAU/General-Stories-Mistral-7B-Q6_K-GGUF

Updated Apr 24, 2024 • 7 • 1

DavidAU/Young-Children-Storyteller-Mistral-7B-Q6_K-GGUF

Updated Apr 24, 2024 • 18 • 2

NikolayKozloff/Orbita-v0.1-GGUF

Updated Apr 25, 2024 • 6 • 2

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 1, 2024 • 5 • 1