Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

74,047

Full-text search

Active filters: gguf

Rookie/Llama-3-8B-Instruct-Chinese

Text Generation • Updated Apr 24, 2024 • 1.54k • 32

hfl/llama-3-chinese-8b-gguf

Updated Apr 30, 2024 • 236 • 8

jayasuryajsk/Llama-3-telugu

Text Generation • Updated May 10, 2024 • 95 • 2

lamm-mit/BioinspiredLlama-3-8B

Text Generation • Updated Apr 29, 2024 • 220 • 1

Lewdiculous/L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix

Updated May 15, 2024 • 73 • 11

microsoft/Phi-3-mini-4k-instruct-gguf

Text Generation • Updated Jul 2, 2024 • 10.3k • 471

bartowski/General-Stories-Mistral-7B-GGUF

Text Generation • Updated Apr 22, 2024 • 251 • 4

mradermacher/Scarlett-Llama-3-8B-GGUF

Updated May 6, 2024 • 24 • 2

bartowski/Scarlett-Llama-3-8B-GGUF

Text Generation • Updated Apr 23, 2024 • 142 • 3

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit

Text Generation • Updated Jul 4, 2024 • 921 • 166

PrunaAI/Llama3-8B-Chinese-Chat-GGUF-smashed

Updated Aug 2, 2024 • 608 • 30

Anoxiom/Scarlett-Llama-3-8B-Q6_K-GGUF

Updated Apr 23, 2024 • 1 • 1

mradermacher/Omnia-2x7B-GGUF

Updated Dec 12, 2024 • 68 • 1

Orenguteng/Llama-3-8B-Lexi-Uncensored-GGUF

Updated Apr 23, 2024 • 13.4k • 199

DavidAU/General-Stories-Mistral-7B-Q6_K-GGUF

Updated Apr 24, 2024 • 1

DavidAU/Scarlett-Llama-3-8B-Q8_0-GGUF

Updated Apr 24, 2024 • 1 • 1

DavidAU/Young-Children-Storyteller-Mistral-7B-Q6_K-GGUF

Updated Apr 24, 2024 • 5 • 2

art-from-the-machine/Mantella-Skyrim-Llama-3-8B-GGUF

Updated Apr 24, 2024 • 1.69k • 4

yuuko-eth/Chihiro-7B-v0.1-GGUF

Text Generation • Updated May 1, 2024 • 22 • 3

teddylee777/Llama-3-Open-Ko-8B-gguf

Text Generation • Updated May 20, 2024 • 990 • 41

xtuner/llava-phi-3-mini-gguf

Image-to-Text • Updated Apr 29, 2024 • 5.74k • 128

teddylee777/EEVE-Korean-Instruct-10.8B-v1.0-gguf

Text Generation • Updated Apr 25, 2024 • 637 • 20

Orenguteng/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Updated Apr 28, 2024 • 4.76k • 42

nctu6/Llama3-TAIDE-LX-8B-Chat-Alpha1-GGUF

Updated Nov 19, 2024 • 413 • 5

chenhaodev/OpenBioLLM-Llama3-70B-GGUF

Text Generation • Updated Apr 26, 2024 • 34 • 3

pooka74/LLaMA3-8B-Chat-Chinese-GGUF

Updated Apr 26, 2024 • 2 • 1

cjpais/moondream2-llamafile

Image-Text-to-Text • Updated May 9, 2024 • 273 • 27

scowen/deepseek-coder-6.7b-vala

Updated Oct 9, 2024 • 26 • 2

georgesung/llama3_8b_chat_uncensored

Text Generation • Updated Apr 30, 2024 • 1.07k • 14

Local-Novel-LLM-project/Vecteus-v1-gguf

Text Generation • Updated May 3, 2024 • 441 • 7