Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

74,003

Full-text search

Active filters: gguf

DavidAU/Rosa_v1_3B-Q6_K-GGUF

Updated Apr 12, 2024 • 1 • 2

ManniX-ITA/Starling-LM-7B-beta-LaserRMT-v1-GGUF

Updated Apr 12, 2024 • 42 • 2

Lewdiculous/Nyanade_Stunna-Maid-7B-GGUF-IQ-Imatrix

Updated Apr 14, 2024 • 107 • 11

DavidAU/ANIMA-Phi-Neptune-Mistral-10.7B-Q6_K-GGUF

Text Generation • Updated Apr 14, 2024 • 1 • 1

mradermacher/ANIMA-Phi-Neptune-Mistral-10.7B-GGUF

Updated May 6, 2024 • 40 • 1

ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2

Text Generation • Updated May 27, 2024 • 172 • 16

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4, 2024 • 1.93k • 48

taide/TAIDE-LX-7B-Chat-4bit

Updated May 21, 2024 • 138 • 69

soramikaduki/Antler-RP-ja-westlake-chatvector_GGUF

Updated Apr 16, 2024 • 33 • 1

mradermacher/Euryale-L2-70B-i1-GGUF

Updated May 6, 2024 • 38 • 1

rootsec1/gemma-2B-inst-aipi

Text Generation • Updated Apr 18, 2024 • 24 • 2

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 2.6M • 79

bartowski/Meta-Llama-3-8B-Instruct-GGUF-special-tokens

Text Generation • Updated Apr 19, 2024 • 439 • 13

lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated May 3, 2024 • 6.53k • 176

smangrul/llama-3-8B-instruct-function-calling

Updated Apr 21, 2024 • 32 • 29

IlyaGusev/saiga_llama3_8b_gguf

Text Generation • Updated Jul 4, 2024 • 1.56k • 78

lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 3, 2024 • 534 • 111

wirytiox/Gemma7B-konosuba

Text Generation • Updated Apr 21, 2024 • 21 • 1

mradermacher/Chimera-8B-GGUF

Updated 28 days ago • 149 • 1

mradermacher/Aura_Uncensored_l3_8B-GGUF

Updated May 6, 2024 • 110 • 2

cognitivecomputations/dolphin-2.9-llama3-8b-gguf

Updated May 20, 2024 • 1.13k • 85

DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF

Text Generation • Updated Apr 21, 2024 • 12 • 3

babycommando/babydolphin-8b-llama3-uncensored

Updated Apr 22, 2024 • 343 • 4

NyxKrage/llama3-42b-v0-imat-gguf

Updated Apr 22, 2024 • 344 • 6

mradermacher/General-Stories-Mistral-7B-GGUF

Updated May 5, 2024 • 37 • 2

Rookie/Llama-3-8B-Instruct-Chinese

Text Generation • Updated Apr 24, 2024 • 1.54k • 32

hfl/llama-3-chinese-8b-gguf

Updated Apr 30, 2024 • 236 • 8

jayasuryajsk/Llama-3-telugu

Text Generation • Updated May 10, 2024 • 95 • 2

lamm-mit/BioinspiredLlama-3-8B

Text Generation • Updated Apr 29, 2024 • 220 • 1

Lewdiculous/L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix

Updated May 15, 2024 • 73 • 11