Edit Models filters

Inference status

Misc

Inference Endpoints

Merge

text-generation-inference

text-embeddings-inference

Misc with no match

gguf

Models

74,046

Full-text search

Active filters: gguf

vonjack/bge-m3-gguf

mradermacher/Uncensored-Frank-Llama-3-8B-GGUF

Updated May 5, 2024 • 254 • 3

mradermacher/Versatile-Llama-3-8B-GGUF

Updated 28 days ago • 148 • 1

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-4bit

Text Generation • Updated Jul 4, 2024 • 711 • 25

Fugaku-LLM/Fugaku-LLM-13B-instruct-gguf

Updated May 9, 2024 • 97 • 36

failspy/Llama-3-8B-Instruct-abliterated-GGUF

Updated May 7, 2024 • 193 • 28

gaianet/Nomic-embed-text-v1.5-Embedding-GGUF

Updated May 8, 2024 • 12.1k • 4

ddh0/Phi-3-mini-4k-instruct-bf16-GGUF

Text Generation • Updated May 11, 2024 • 45 • 3

backyardai/Smart-Lemon-Cookie-7B-GGUF

Text Generation • Updated May 22, 2024 • 3.29k • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22, 2024 • 1.73k • 7

second-state/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated Jul 2, 2024 • 1.31k • 7

AdityaXPV/Llama-3-8b-Instruct-law-sage-v0.1-GGUF

Updated Dec 4, 2024 • 165 • 2

bartowski/Pantheon-RP-1.0-8b-Llama-3-GGUF

Text Generation • Updated May 12, 2024 • 241 • 7

mradermacher/Aura-Uncensored-OAS-8B-L3-GGUF

Updated Jun 26, 2024 • 205 • 4

mradermacher/llama-3-70B-Instruct-abliterated-GGUF

Updated May 13, 2024 • 44 • 4

nmerkle/Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf

Updated May 13, 2024 • 43 • 3

bartowski/Cat-Llama-3-70B-instruct-GGUF

Text Generation • Updated May 13, 2024 • 447 • 10

theprint/mistral-7b-cthulhu

Text Generation • Updated May 14, 2024 • 65 • 2

openerotica/Llama-3-lima-nsfw-16k-test-GGUF

Updated May 17, 2024 • 219 • 7

SakuraLLM/Sakura-14B-Qwen2beta-v0.9.2-GGUF

Updated Jun 26, 2024 • 803 • 9

openbmb/MiniCPM-Llama3-V-2_5-gguf

Updated Aug 19, 2024 • 7.11k • 210