Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,737

Full-text search

Active filters: quantized

MaziyarPanahi/L3-Nymeria-v2-8B-GGUF

Text Generation • Updated Oct 28 • 41

MaziyarPanahi/L3-Rhaenys-8B-GGUF

Text Generation • Updated Oct 28 • 54

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • Updated Oct 28 • 77

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-GGUF

Text Generation • Updated Oct 29 • 57

MaziyarPanahi/llama-3-8b-chat-reglamentacion-V1-GGUF

Text Generation • Updated Oct 29 • 57

MaziyarPanahi/Einstein-v6.1-Llama3-8B-GGUF

Text Generation • Updated Oct 29 • 45

MaziyarPanahi/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF

Text Generation • Updated Oct 29 • 41

MaziyarPanahi/badger-mu-llama-3-8b-GGUF

Text Generation • Updated Oct 29 • 17

MaziyarPanahi/KONI-Llama3-8B-20240630-GGUF

Text Generation • Updated Oct 29 • 36

MaziyarPanahi/badger-lambda-llama-3-8b-GGUF

Text Generation • Updated Oct 29 • 24

MaziyarPanahi/qwen-2.5-7B-DPO-split1-16bit-chunk34-GGUF

Text Generation • Updated Oct 29 • 14

MaziyarPanahi/Qwen2.5-3B-RP-Mix-GGUF

Text Generation • Updated Oct 30 • 40

MaziyarPanahi/FastApply-7B-v1.0-GGUF

Text Generation • Updated Oct 30 • 151

MaziyarPanahi/FastApply-1.5B-v1.0-GGUF

Text Generation • Updated Oct 30 • 89

MaziyarPanahi/ruadapt_qwen2.5_3B_ext_u48_instruct_v4-GGUF

Text Generation • Updated Oct 30 • 242

MaziyarPanahi/MiniPLM-Qwen-500M-GGUF

Text Generation • Updated Oct 30 • 29

MaziyarPanahi/MiniPLM-Qwen-1.2B-GGUF

Text Generation • Updated Oct 30 • 48

MaziyarPanahi/Qwen2.5-Coder-1.5B-CodeFIM-GGUF

Text Generation • Updated Oct 30 • 38

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v3-GGUF

Text Generation • Updated Oct 30 • 153

MaziyarPanahi/SuperCorrect-7B-GGUF

Text Generation • Updated Oct 30 • 72

MaziyarPanahi/WavGPT-1.5-GGUF

Text Generation • Updated Oct 30 • 43

MaziyarPanahi/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.1-GGUF

Text Generation • Updated Oct 30 • 145

MaziyarPanahi/chinese-text-correction-7b-GGUF

Text Generation • Updated Oct 30 • 84

MaziyarPanahi/chinese-text-correction-1.5b-GGUF

Text Generation • Updated Oct 30 • 54

MaziyarPanahi/Qwen2.5-7B-Gutenberg-KTO-GGUF

Text Generation • Updated Oct 30 • 80

MaziyarPanahi/Arch-Function-7B-GGUF

Text Generation • Updated Oct 30 • 21

MaziyarPanahi/Rombos-LLM-V2.5-Qwen-7b-GGUF

Text Generation • Updated Oct 30 • 103

MaziyarPanahi/raspberry-3B-GGUF

Text Generation • Updated Oct 30 • 22

MaziyarPanahi/CursorCore-QW2.5-7B-GGUF

Text Generation • Updated Oct 30 • 66

MaziyarPanahi/Vi-Qwen2-7B-RAG-GGUF

Text Generation • Updated Oct 30 • 28