Inference Providers
Active filters: 3-bit
deucebucket/Qwen3.6-35B-A3B-Cerebellum-GGUF
Image-Text-to-Text
• 35B • Updated • 1.46k
• 8
MaziyarPanahi/Synatra-7B-v0.3-RP-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 151
• 1
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
• 141B • Updated • 116k
• 77
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
• 12B • Updated • 114k
• 52
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 113k
• 9
MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit
Text Generation
• 121B • Updated • 737
• 4
RepublicOfKorokke/Qwen3-Coder-Next-REAP-48B-A3B-oQ3.5
Text Generation
• 7B • Updated • 652
• 2
manjunathshiva/gpt-oss-20b-tq3
Text Generation
• 22B • Updated • 3.77k
• 46
88B • Updated • 35.9k
• 13
unsloth/Qwen3.6-35B-A3B-UD-MLX-3bit
Image-Text-to-Text
• 5B • Updated • 11.8k
• 8
bearzi/gemma-4-26B-A4B-it-oQ3
Text Generation
• 4B • Updated • 213
• 1
deucebucket/Gemma-4-26B-A4B-it-Cerebellum-v6-GGUF
Image-Text-to-Text
• 25B • Updated • 3.62k
• 9
cpral/Qwen3.5-397B-A17B-exl3-4.61bpw
Updated • 47
• 1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 6
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 9
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 13
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 4
Text Generation
• Updated • 11
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 10
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
• 6B • Updated • 4
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
• 6B • Updated • 6
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
• 3B • Updated • 4
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
• 3B • Updated • 7
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
• 31B • Updated • 5
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
• 65B • Updated • 7
SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT
Text Generation
• 31B • Updated • 5
kaitchup/Mistral-7B-v0.1-gptq-3bit
Text Generation
• 7B • Updated • 6
kaitchup/Llama-2-13b-hf-gptq-3bit
Text Generation
• 12B • Updated • 6
kaitchup/Llama-2-7b-hf-gptq-3bit
Text Generation
• 6B • Updated • 191
• 1
Text Generation
• 3B • Updated • 233
• 6