Models

LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct-AWQ

Text Generation • 2B • Updated Dec 11, 2024 • 914 • 15

Wiseyak/OpenWiseyak-0.1-Base-4bit

Text Generation • 5B • Updated Dec 31, 2024 • 3 • 4

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • 5B • Updated Feb 14 • 1.95k • 24

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • 18B • Updated Feb 14 • 188k • 27

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • 5B • Updated Jul 18 • 38.4k • 36

unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit

Text Generation • 0.8B • Updated Apr 26 • 48.3k • 5

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • 13B • Updated Mar 7 • 53.5k • 66

Qwen/QwQ-32B-AWQ

Text Generation • 6B • Updated Mar 11 • 7.51k • 132

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12 • 138k • 13

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • 6B • Updated Apr 6 • 23.6k • 35

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

18B • Updated May 4 • 6.76k • 6

unsloth/gemma-3-12b-it-qat-bnb-4bit

Image-Text-to-Text • 7B • Updated May 12 • 515 • 2

saki007ster/Cybersecurity-7B-v0.2-Q6-mlx

Text Generation • 2B • Updated Apr 24 • 11 • 1

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • 0.4B • Updated Jun 23 • 84.9k • 19

mlx-community/Qwen3-0.6B-4bit

Text Generation • 93.2M • Updated Apr 28 • 4.31k • 6

mlx-community/Qwen3-8B-4bit

Text Generation • 1B • Updated Apr 28 • 1.98k • 6

Orion-zhen/Qwen3-0.6B-AWQ

0.2B • Updated Apr 29 • 1.32k • 5

Qwen/Qwen3-14B-AWQ

Text Generation • 3B • Updated May 21 • 203k • 42

QuixiAI/Qwen3-235B-A22B-AWQ

Text Generation • 33B • Updated May 4 • 124 • 13

huihui-ai/Qwen3-14B-abliterated-nf4

Text Generation • 8B • Updated Jun 9 • 7 • 2

unsloth/medgemma-4b-it-bnb-4bit

Image-Text-to-Text • 3B • Updated May 20 • 295 • 5

Qwen/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated Aug 29 • 76.1k • 17

adamo1139/DeepSeek-V2.5-1210-AWQ

35B • Updated Sep 18 • 16 • 1

mlx-community/gemma-3n-E2B-it-lm-4bit

Text Generation • 0.7B • Updated Jun 29 • 5k • 2

mlx-community/Kimi-K2-Instruct-4bit

Text Generation • 1T • Updated Jul 11 • 2.18k • 11

mlx-community/Qwen3-Coder-480B-A35B-Instruct-4bit

Text Generation • 480B • Updated Jul 22 • 458 • 19

QuantTrio/GLM-4.5-Air-AWQ-FP16Mix

Text Generation • 24B • Updated Sep 5 • 8.27k • 13

Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound

2B • Updated 15 days ago • 15.3k • 5

AlekseyCalvin/QWEN_IMAGE_fp4_w_AbliteratedTE_Diffusers

Text-to-Image • Updated Aug 6 • 109 • 6

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-4bit

Text Generation • 0.6B • Updated Aug 6 • 103k • 2