majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-8bit
Image-Text-to-Text • 35B • Updated • 3.35k • 6
Edit Models filters
Apps
Inference Providers
Active filters: kv-cache-quantization
majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit
Image-Text-to-Text • 35B • Updated • 5.16k • 9
majentik/Qwen3.6-35B-A3B-TurboQuant
Image-Text-to-Text • Updated • 10
majentik/gemma-4-E2B-it-TurboQuant
Image-Text-to-Text • Updated • 1
majentik/gemma-4-E2B-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 5B • Updated • 54 • 1
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 5B • Updated • 137 • 2
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-4bit
Text Generation • 32B • Updated • 210 • 1
majentik/gpt-oss-20b-TurboQuant-MLX-4bit
Text Generation • 21B • Updated • 698 • 1
majentik/MiniMax-M2.7-TurboQuant-MLX-5bit
Text Generation • 229B • Updated • 916 • 1
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit
Image-Text-to-Text • 35B • Updated • 4.88k • 5
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-3bit
Image-Text-to-Text • 35B • Updated • 1.53k • 3
majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit
Image-Text-to-Text • 35B • Updated • 2.61k • 5
rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 9
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 5
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 10
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 28
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 11
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 4
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 3
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 4
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 2
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 7
majentik/gemma-4-E4B-turboquant
Image-Text-to-Text • 8B • Updated • 309 • 7
majentik/MERaLiON-3-10B-TurboQuant
Automatic Speech Recognition • Updated
majentik/MERaLiON-2-3B-TurboQuant
Automatic Speech Recognition • Updated
majentik/MERaLiON-2-10B-TurboQuant
Automatic Speech Recognition • Updated
majentik/gemma-4-E4B-rotorquant
Image-Text-to-Text • Updated • 1
majentik/MERaLiON-3-10B-RotorQuant
Automatic Speech Recognition • Updated
majentik/MERaLiON-2-10B-RotorQuant
Automatic Speech Recognition • Updated
majentik/MERaLiON-2-3B-RotorQuant
Automatic Speech Recognition • Updated