Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,619

Full-text search

Active filters: 4-bit

rwitz/cat0.1

Text Generation • Updated Oct 23 • 31 • 1

thwin27/Aria-sequential_mlp-bnb_nf4

Image-Text-to-Text • Updated Oct 23 • 549 • 10

MaziyarPanahi/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 24 • 379 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 27 days ago • 1.71k • 1

xmadai/Mistral-Large-Instruct-2407-xMADai-INT4

Text Generation • Updated 28 days ago • 5.39k • 6

YouSSeung/Llama-YSH-ko-3-8B

Updated Oct 24 • 17 • 1

ronmasas/omniparser-4bit

Updated Oct 26 • 23 • 1

xmadai/gemma-2-9b-it-xMADai-INT4

Text Generation • Updated 28 days ago • 33 • 4

AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4

Image-Text-to-Text • Updated 16 days ago • 385 • 4

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.0bpw-h6-exl2

Updated about 1 month ago • 1.04k • 1

MaziyarPanahi/L3-Nymeria-8B-GGUF

Text Generation • Updated 30 days ago • 349 • 3

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF

Text Generation • Updated 30 days ago • 259 • 2

MaziyarPanahi/L3-8B-Sunfall-v0.4-Lunar-Stheno-GGUF

Text Generation • Updated 29 days ago • 173 • 1

xmadai/Llama-3.1-Nemotron-70B-Instruct-xMADai-INT4

Text Generation • Updated 28 days ago • 756 • 4

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated 21 days ago • 3.11k • 2

MaziyarPanahi/cybertron-v4-qw7B-MGS-GGUF

Text Generation • Updated 28 days ago • 279 • 1

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Text Generation • Updated 28 days ago • 288 • 1

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated 28 days ago • 311 • 1

amornpan/openthaigpt1.5-14b-MedChatModelV1

Text Generation • Updated 23 days ago • 35 • 1

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2

Text Generation • Updated 16 days ago • 94 • 3

arifulFarhad/Rombos-LLM-V2.6-Qwen-14b-gptq-int4

Updated 16 days ago • 131 • 2

MaziyarPanahi/uncertain_mistral_7b-GGUF

Text Generation • Updated 27 days ago • 107 • 1

ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3

Text Generation • Updated 16 days ago • 745 • 3

MaziyarPanahi/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 24 days ago • 764k • 3

MaziyarPanahi/Llama-3.2-3B-Apex-GGUF

Text Generation • Updated 26 days ago • 185 • 3

MaziyarPanahi/L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-GGUF

Text Generation • Updated 26 days ago • 469 • 1

MaziyarPanahi/L3.1-Promissum_Mane-8B-Della-1.5-calc-GGUF

Text Generation • Updated 26 days ago • 146 • 1

MaziyarPanahi/uncertain_llama3_8b-GGUF

Text Generation • Updated 26 days ago • 138 • 1

divyachand/google-gemma-2-9b-q

Text Generation • Updated 25 days ago • 24 • 1

automatedstockminingorg/14b-stockanalyst-14b-stockanalyst

Text Generation • Updated 25 days ago • 58 • 1