Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

73,825

Full-text search

Active filters: gguf

Mozilla/llava-v1.5-7b-llamafile

Updated Aug 19, 2024 • 10.7k • 177

TinyLlama/TinyLlama-1.1B-Chat-v0.6

Text Generation • Updated Nov 20, 2023 • 16.8k • 92

TheBloke/GOAT-70B-Storytelling-GGUF

Updated Nov 20, 2023 • 759 • 12

TheBloke/Noromaid-20B-v0.1.1-GGUF

Updated Nov 23, 2023 • 509 • 23

TheBloke/Yi-34B-Chat-GGUF

Text Generation • Updated Nov 23, 2023 • 1.23k • 66

tastypear/CausalLM-14B-DPO-alpha-GGUF

Text Generation • Updated Nov 25, 2023 • 2.37k • 66

zgce/acsr-v2-yi34b_GGUF

Updated Dec 1, 2023 • 36 • 11

google/madlad400-3b-mt

Translation • Updated Nov 27, 2023 • 6.53k • 106

Steward/lcm-dreamshaper-v7-gguf

Updated Nov 28, 2023 • 50 • 2

TheBloke/deepseek-llm-67b-chat-GGUF

Updated Nov 29, 2023 • 2.55k • 37

TheBloke/LLaMA2-13B-Psyfighter2-GGUF

Updated Nov 30, 2023 • 403 • 16

TheBloke/Chronomaid-Storytelling-13B-GGUF

Updated Dec 4, 2023 • 719 • 23

TIGER-Lab/TIGERScore-13B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 58 • 1

TheBloke/dolphin-2.5-mixtral-8x7b-GGUF

Updated Dec 14, 2023 • 5.56k • 300

neph1/bellman-7b-mistral-instruct-v0.2

Text Generation • Updated Apr 13, 2024 • 243 • 12

TheBloke/phi-2-GGUF

Text Generation • Updated Dec 18, 2023 • 26.8k • 193

TheBloke/SOLAR-10.7B-Instruct-v1.0-uncensored-GGUF

Updated Dec 19, 2023 • 11.1k • 79

afrideva/minima-3b-layla-v2-GGUF

Text Generation • Updated Dec 19, 2023 • 45 • 4

TheBloke/WhiteRabbitNeo-13B-GGUF

Updated Dec 21, 2023 • 1.05k • 48

nakodanei/ShareGPT4V-13B_GGUF

Updated Dec 21, 2023 • 163 • 7

TheBloke/dolphin-2.6-mixtral-8x7b-GGUF

Updated Dec 22, 2023 • 1.24k • 47

acon96/Home-3B-v1-GGUF

Text Generation • Updated Jan 6, 2024 • 23 • 15

TheBloke/DaringMaid-13B-GGUF

Text Generation • Updated Dec 24, 2023 • 261 • 5

TheBloke/finance-LLM-GGUF

Text Generation • Updated Dec 24, 2023 • 564 • 17

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GGUF

Text Generation • Updated Dec 25, 2023 • 193 • 10

uukuguy/speechless-coder-ds-6.7b

Text Generation • Updated Jan 7, 2024 • 755 • 6

TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF

Updated Dec 31, 2023 • 19.1k • 117

TheBloke/dolphin-2.7-mixtral-8x7b-GGUF

Updated Jan 1, 2024 • 8.91k • 137

TheBloke/Nous-Hermes-2-SOLAR-10.7B-GGUF

Updated Jan 2, 2024 • 1.24k • 110

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2, 2024 • 67 • 2