Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

164

Full-text search

Active filters: granite

mradermacher/granite-20b-code-base-i1-GGUF

Updated Aug 31 • 395 • 1

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1 • 709

mradermacher/granite-3b-code-base-128k-GGUF

Updated Sep 4 • 79

mradermacher/granite-3b-code-base-2k-GGUF

Updated Sep 3 • 186

mradermacher/granite-3b-code-instruct-2k-GGUF

Updated Sep 4 • 7

mradermacher/granite-3b-code-base-2k-i1-GGUF

Updated Sep 3 • 281

mradermacher/granite-8b-code-base-128k-GGUF

Updated Sep 3 • 112

mradermacher/granite-8b-code-base-128k-i1-GGUF

Updated Sep 4 • 370 • 1

mradermacher/granite-8b-code-base-4k-GGUF

Updated Sep 4 • 20

mradermacher/granite-8b-code-instruct-4k-GGUF

Updated Sep 4 • 171

mradermacher/granite-20b-code-base-8k-GGUF

Updated Sep 4 • 137

mradermacher/granite-20b-code-instruct-8k-GGUF

Updated Sep 3 • 57

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

Updated Sep 6 • 96

mradermacher/granite-34b-code-base-8k-GGUF

Updated Sep 4 • 45

mradermacher/granite-3b-code-base-128k-i1-GGUF

Updated Sep 4 • 216

mradermacher/granite-8b-code-instruct-4k-i1-GGUF

Updated Sep 4 • 234

mradermacher/granite-3b-code-instruct-2k-i1-GGUF

Updated Sep 4 • 167

mradermacher/granite-20b-code-base-8k-i1-GGUF

Updated Sep 4 • 520

mradermacher/granite-8b-code-base-4k-i1-GGUF

Updated Sep 5 • 152

mradermacher/granite-34b-code-base-8k-i1-GGUF

Updated Sep 4 • 303

QuantFactory/granite-7b-instruct-GGUF

Text Generation • Updated Sep 5 • 183 • 2

royleibov/granite-7b-instruct-ZipNN-Compressed

Text Generation • Updated Sep 15 • 60 • 2

QuantFactory/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 7 • 147 • 2

QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7 • 285 • 2

QuantFactory/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 7 • 137 • 2

Triangle104/granite-8b-code-instruct-4k-Q4_0-GGUF

Text Generation • Updated Sep 7 • 17

Triangle104/granite-8b-code-instruct-4k-Q4_K_S-GGUF

Text Generation • Updated Sep 7 • 7

Triangle104/granite-8b-code-instruct-4k-Q4_K_M-GGUF

Text Generation • Updated Sep 7 • 4

Triangle104/granite-8b-code-instruct-4k-Q5_0-GGUF

Text Generation • Updated Sep 7 • 216

Triangle104/granite-8b-code-instruct-4k-Q5_K_S-GGUF

Text Generation • Updated Sep 8 • 3