Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

73,945

Full-text search

Active filters: gguf

core-3/kuno-dogpark-7b-GGUF

Updated Mar 3, 2024 • 3 • 2

remyxai/SpaceLLaVA

Text Generation • Updated Oct 3, 2024 • 219 • 20

stabilityai/stable-code-instruct-3b

Text Generation • Updated Jul 10, 2024 • 1.73k • 167

mradermacher/Midnight-Miqu-103B-v1.0-GGUF

Updated May 6, 2024 • 40 • 7

RANDMEDIATION/phoster

Updated Mar 15, 2024 • 2 • 1

gorilla-llm/gorilla-openfunctions-v2-gguf

Updated Apr 18, 2024 • 496 • 38

second-state/All-MiniLM-L6-v2-Embedding-GGUF

Feature Extraction • Updated May 1, 2024 • 16.7k • 5

mradermacher/Midnight-Rose-70B-v2.0.3-i1-GGUF

Updated May 10, 2024 • 39 • 1

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 96 • 13

Lewdiculous/Prima-LelantaclesV6.69-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 17 • 5

Lewdiculous/Prima-LelantaclesV6.3-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 35 • 4

heegyu/EEVE-Korean-Instruct-10.8B-v1.0-GGUF

Updated Mar 14, 2024 • 861 • 68

mradermacher/Infinitely-Laydiculus-9b-GGUF

Updated 28 days ago • 84 • 2

Lewdiculous/BuRPInfinity_9B-GGUF-IQ-Imatrix

Updated Mar 16, 2024 • 15 • 5

ecastera/ecastera-eva-westlake-7b-spanish-int4-gguf

Updated Mar 16, 2024 • 8 • 2

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

Updated May 11, 2024 • 2 • 1

lukestanley/ChillTranslator

Text Generation • Updated Mar 18, 2024 • 1 • 1

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 100 • 6

mradermacher/IA_14B-GGUF

Updated May 6, 2024 • 23 • 1

munish0838/Matter-0.1-Slim-7B-B-GGUF

Text Generation • Updated Apr 7, 2024 • 40 • 3

chillies/mistral-7b-ielts-evaluator-q4

Updated May 27, 2024 • 52 • 9

mzwing/SDXL-Lightning-GGUF

Updated Mar 22, 2024 • 740 • 10

deccan-ai/phi-2-insurance_qa-sft-lora-gguf-f16

Text Generation • Updated Oct 21, 2024 • 87 • 3

ResplendentAI/Asherah_7B

Text Generation • Updated Mar 21, 2024 • 254 • 7

mradermacher/Midnight-Miqu-103B-v1.5-GGUF

Updated May 6, 2024 • 21 • 3

mmnga/SakanaAI-EvoLLM-JP-A-v1-7B-gguf

Updated Mar 21, 2024 • 175 • 7

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 8 • 23

google/codegemma-7b-GGUF

Text Generation • Updated Jun 27, 2024 • 11 • 17

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 10 • 51

mradermacher/Eris_PrimeV3.075-Vision-7B-GGUF

Updated 28 days ago • 136 • 2