Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,696

Full-text search

Active filters: 3-bit

Xu-Ouyang/pythia-2.8b-deduped-int3-step256-GPTQ-wikitext2

Text Generation • Updated 11 days ago • 7

Xu-Ouyang/pythia-2.8b-deduped-int3-step512-GPTQ-wikitext2

Text Generation • Updated 11 days ago • 7

Xu-Ouyang/pythia-2.8b-deduped-int3-step1000-GPTQ-wikitext2

Text Generation • Updated 11 days ago • 7

MaziyarPanahi/openthaigpt1.5-7b-instruct-GGUF

Text Generation • Updated 11 days ago • 129

MaziyarPanahi/Qwen2.5-7B-Instruct-Uncensored-GGUF

Text Generation • Updated 11 days ago • 190

MaziyarPanahi/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 11 days ago • 101

MaziyarPanahi/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated 11 days ago • 117

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated 11 days ago • 135

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated 11 days ago • 660k

MaziyarPanahi/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated 11 days ago • 163

MaziyarPanahi/Einstein-v7-Qwen2-7B-GGUF

Text Generation • Updated 11 days ago • 99

MaziyarPanahi/CabraQwen7b-GGUF

Text Generation • Updated 10 days ago • 102

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated 10 days ago • 70

MaziyarPanahi/Qwen2.5-3B-Loki-GGUF

Text Generation • Updated 10 days ago • 113

MaziyarPanahi/Arcee-VyLinh-GGUF

Text Generation • Updated 10 days ago • 149

MaziyarPanahi/ruadapt_qwen2.5_7B_ext_u48_instruct-GGUF

Text Generation • Updated 10 days ago • 139

MaziyarPanahi/Qwen2.5-7B-CyberRombos-GGUF

Text Generation • Updated 9 days ago • 175

MaziyarPanahi/Qwen2.5-3B-Instruct-abliterated-GGUF

Text Generation • Updated 9 days ago • 162

MaziyarPanahi/WASSA2024_EmpathyDetection_Chinchunmei_EXP305-GGUF

Text Generation • Updated 8 days ago • 132

MaziyarPanahi/SD3_prompt-llama_8b-GGUF

Text Generation • Updated 8 days ago • 151

MaziyarPanahi/llama3-8B-aifeifei-1.3-GGUF

Text Generation • Updated 8 days ago • 113

MaziyarPanahi/llama3-8B-aifeifei-1.2-GGUF

Text Generation • Updated 8 days ago • 115

MaziyarPanahi/llama3-8B-aifeifei-1.1-GGUF

Text Generation • Updated 8 days ago • 120

MaziyarPanahi/llama3-8B-aifeifei-1.0-GGUF

Text Generation • Updated 8 days ago • 113

MaziyarPanahi/Kancil-V1-llama3-fp16-GGUF

Text Generation • Updated 8 days ago • 116

MaziyarPanahi/CosmicBun-8B-GGUF

Text Generation • Updated 7 days ago • 118

MaziyarPanahi/llama-3-8b-English-to-Hinglish-GGUF

Text Generation • Updated 7 days ago • 113

MaziyarPanahi/MeowGPT-ll3-GGUF

Text Generation • Updated 7 days ago • 110

MaziyarPanahi/OpenChat-3.5-0106_32K-PoSE-GGUF

Text Generation • Updated 7 days ago • 60

MaziyarPanahi/Mistral-Crab-SFT-GGUF

Text Generation • Updated 7 days ago • 77