Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

73,892

Full-text search

Active filters: gguf

TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF

Updated Dec 31, 2023 • 19.1k • 117

TheBloke/dolphin-2.7-mixtral-8x7b-GGUF

Updated Jan 1, 2024 • 8.91k • 137

TheBloke/Nous-Hermes-2-SOLAR-10.7B-GGUF

Updated Jan 2, 2024 • 1.24k • 110

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2, 2024 • 67 • 2

TheBloke/Kunoichi-7B-GGUF

Updated Jan 5, 2024 • 2.12k • 31

elliotthwang/KimLan_mistral.GGUF

Updated Jan 6, 2024 • 1

stabilityai/stable-code-3b

Text Generation • Updated Jul 10, 2024 • 3.7k • 637

TheBloke/Sensualize-Mixtral-GGUF

Updated Jan 10, 2024 • 352 • 20

meetkai/functionary-small-v2.2-GGUF

Updated Jan 24, 2024 • 137 • 14

segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF

Updated Jan 20, 2024 • 988 • 15

TheBloke/deepmoney-34b-200k-base-GGUF

Updated Jan 13, 2024 • 398 • 14

KoboldAI/Mistral-7B-Holodeck-1-GGUF

Text Generation • Updated Jan 15, 2024 • 354 • 8

KoboldAI/LLaMA2-13B-Estopia-GGUF

Updated Jan 14, 2024 • 1.92k • 12

SakuraLLM/Sakura-7B-LNovel-v0.9-GGUF

Updated Jun 26, 2024 • 2.43k • 5

TheBloke/finance-LLM-13B-GGUF

Text Generation • Updated Jan 15, 2024 • 565 • 17

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF

Updated Jan 16, 2024 • 1.45k • 57

brittlewis12/Kunoichi-DPO-v2-7B-GGUF

Text Generation • Updated May 2, 2024 • 1.44k • 60

TheBloke/NeuralBeagle14-7B-GGUF

Updated Jan 17, 2024 • 495 • 26

macadeliccc/laser-dolphin-mixtral-2x7b-dpo-GGUF

Updated Feb 6, 2024 • 166 • 9

stabilityai/stablelm-2-zephyr-1_6b

Text Generation • Updated Jun 3, 2024 • 6.08k • 182

brittlewis12/stablelm-2-zephyr-1_6b-GGUF

Text Generation • Updated Jan 21, 2024 • 118 • 9

TheBigBlender/EstopianMaid-GGUF

Updated Jan 24, 2024 • 336 • 12

motherduckdb/DuckDB-NSQL-7B-v0.1-GGUF

Updated Jan 25, 2024 • 107 • 21

TheBloke/WestLake-7B-v2-GGUF

Updated Jan 24, 2024 • 298 • 19

recogna-nlp/bode-7b-alpaca-pt-br-gguf

Text Generation • Updated Oct 25, 2024 • 302 • 24

miqudev/miqu-1-70b

Updated Feb 4, 2024 • 7.91k • 981

TheBloke/EstopianMaid-13B-GGUF

Updated Jan 26, 2024 • 2.28k • 46

TheBloke/Etheria-55b-v0.1-GGUF

Updated Jan 26, 2024 • 435 • 8

MaziyarPanahi/ANIMA-Phi-Neptune-Mistral-7B-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 61 • 1

TheBloke/Tess-10.7B-v1.5b-GGUF

Updated Jan 28, 2024 • 118 • 7