Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

78,240

Full-text search

Active filters: gguf

segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF

Updated Jan 20, 2024 • 2.46k • 16

TheBloke/deepmoney-34b-200k-base-GGUF

Updated Jan 13, 2024 • 599 • 14

KoboldAI/LLaMA2-13B-Estopia-GGUF

Updated Jan 14, 2024 • 2.76k • 13

TheBloke/Dr_Samantha-7B-GGUF

Text Generation • Updated Jan 17, 2024 • 280 • 22

uonlp/Vistral-7B-Chat-gguf

Text Generation • Updated Feb 2, 2024 • 477 • 14

TheBloke/WestLake-7B-v2-GGUF

Updated Jan 24, 2024 • 218 • 19

miqudev/miqu-1-70b

Updated Feb 4, 2024 • 5.28k • 982

KatyTestHistorical/SultrySilicon-7B-V2-GGUF

Updated May 9, 2024 • 113 • 12

TheBloke/CodeLlama-70B-Instruct-GGUF

Text Generation • Updated Jan 30, 2024 • 2.39k • 56

Sosnitskij/ruGPT-3.5-13B-erotic-kink-chat-lora-merge-gguf

Text Generation • Updated Jan 30, 2024 • 338 • 7

TheBloke/CodeLlama-70B-Python-GGUF

Text Generation • Updated Jan 31, 2024 • 1.41k • 41

TheBloke/KafkaLM-70B-German-V0.1-GGUF

Text Generation • Updated Jan 31, 2024 • 822 • 24

cjpais/llava-1.6-mistral-7b-gguf

Image-Text-to-Text • Updated Mar 6, 2024 • 10.1k • 97

wolfram/miqu-1-120b-GGUF

Updated Feb 6, 2024 • 9 • 19

defog/sqlcoder-7b-2

Text Generation • Updated Feb 12, 2024 • 80.5k • 308

google/gemma-7b-it

Text Generation • Updated Aug 14, 2024 • 84.5k • 1.15k

Himitsui/Kaiju-11B-GGUF

Updated Feb 13, 2024 • 2.15k • 16

nomic-ai/nomic-embed-text-v1.5-GGUF

Sentence Similarity • Updated Aug 1, 2024 • 7.67k • 58

LoneStriker/LWM-Text-Chat-128K-GGUF

Updated Feb 16, 2024 • 6 • 2

crestf411/daybreak-kunoichi-dpo-7b-gguf

Updated Feb 19, 2024 • 39 • 5

crestf411/daybreak-kunoichi-2dpo-7b-gguf

Updated Feb 20, 2024 • 114 • 18

KoboldAI/Mixtral-8x7B-Holodeck-v1-GGUF

Text Generation • Updated Feb 23, 2024 • 374 • 15

acon96/Home-3B-v3-GGUF

Text Generation • Updated Feb 23, 2024 • 48.6k • 25

second-state/Llava-v1.5-7B-GGUF

Text Generation • Updated Aug 1, 2024 • 20.5k • 8

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 149 • 8

KatyTheCutie/LemonadeRP-4.5.3-GGUF

Text Generation • Updated Mar 2, 2024 • 393 • 26

second-state/StarCoder2-3B-GGUF

Text Generation • Updated Mar 20, 2024 • 969 • 7

NousResearch/Hermes-2-Pro-Mistral-7B-GGUF

Updated Mar 28, 2024 • 8.94k • 226

mradermacher/Fimbulvetr-11B-v2-i1-GGUF

Updated May 6, 2024 • 1.14k • 24

Joseph717171/Models

Updated 5 days ago • 770 • 4