Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

120

Full-text search

Active filters: language

eformat/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 25 • 3

osllmai/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 25 • 28

osllmai/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 25 • 100

farpluto/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 26 • 4

tjake/granite-3.0-2b-instruct-JQ4

Text Generation • Updated Oct 27 • 30

osllmai-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 28 • 20

psolarvi/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 28 • 5

psolarvi/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 28 • 10

marroyo777/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 29 • 11

nlpguy/granite-3.0-3b-a800m-base

Text Generation • Updated Oct 31 • 12

nlpguy/granite-3.0-1b-a400m-base

Text Generation • Updated Oct 31 • 14

taronaeo/Granite-3.0-1B-A400M-Instruct-BE-GGUF

Text Generation • Updated Nov 6 • 151

mav23/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Nov 6 • 294

mav23/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Nov 7 • 335

mav23/granite-3.0-8b-base-GGUF

Text Generation • Updated Nov 9 • 179

tensorblock/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Nov 16 • 177

anime-sssh/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 14 • 9

mradermacher/granite-3.0-8b-instruct-GGUF

Updated Nov 16 • 35

mradermacher/granite-3.0-8b-instruct-i1-GGUF

Updated Nov 16 • 46

mradermacher/granite-3.0-3b-a800m-instruct-GGUF

Updated Nov 17 • 172

mradermacher/granite-3.0-1b-a400m-instruct-GGUF

Updated Nov 16 • 265

mradermacher/granite-3.0-1b-a400m-instruct-i1-GGUF

Updated Nov 16 • 793

mradermacher/granite-3.0-2b-instruct-GGUF

Updated 28 days ago • 309

mradermacher/granite-3.0-2b-instruct-i1-GGUF

Updated 28 days ago • 550

jayakody2000lk/granite-3.0-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated 27 days ago • 27

tensorblock/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated 22 days ago • 241

tensorblock/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated 22 days ago • 269

BSC-NLP4BIA/location-tagger

Token Classification • Updated 22 days ago • 9

tensorblock/granite-3.0-1b-a400m-base-GGUF

Text Generation • Updated 22 days ago • 236

tensorblock/granite-3.0-8b-base-GGUF

Text Generation • Updated 21 days ago • 241