Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,461

Full-text search

Active filters: chat

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 27

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 27

Triangle104/Llama3.1-8B-Fireplace2-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 25

tensorblock/EZO-Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated 2 days ago • 279

MarsupialAI/Dumbstral-169B

Text Generation • Updated 2 days ago • 15

Shamil12/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 19

tensorblock/Qwen2-Math-1.5B-GGUF

Text Generation • Updated 2 days ago • 245

Shamil12/Qwen2.5-Math-1.5B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 23

MarsupialAI/Dumbstral-169B_GGUF

Text Generation • Updated 2 days ago • 34

Khetterman/Llama-3.2-Kapusta-3B-v8-GGUF

Text Generation • Updated about 18 hours ago • 88

Insanelycool/Qwen2.5-Coder-32B-Instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 13

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated 1 day ago • 316

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated 1 day ago • 580

mradermacher/Dumbstral-169B-GGUF

Updated 1 day ago

mradermacher/Dumbstral-169B-i1-GGUF

Updated about 14 hours ago • 51

nolynn/EVA-Instruct-32B-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 21

tensorblock/Qwen2.5-32B-Instruct-abliterated-GGUF

Text Generation • Updated 1 day ago • 318

mradermacher/EVA-Instruct-32B-v2-i1-GGUF

Updated 1 day ago • 542

nolynn/EVA-Instruct-32B-v2-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 26

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q4_K_S-GGUF

Text Generation • Updated 1 day ago • 19

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 19

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q5_K_S-GGUF

Text Generation • Updated 1 day ago • 21

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated 1 day ago • 19

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q6_K-GGUF

Text Generation • Updated 1 day ago • 19

Triangle104/Qwen2.5-1.5B-Instruct-abliterated-Q8_0-GGUF

Text Generation • Updated 1 day ago • 21

Triangle104/Qwen2.5-Coder-14B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 1 day ago • 20