Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

120

Full-text search

Active filters: language

davelsphere/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 5

Fluf22/fashion-clip-inference

Zero-Shot Image Classification • Updated Oct 21 • 25

davelsphere/granite-3.0-8b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 10

davelsphere/granite-3.0-2b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 7

davelsphere/granite-3.0-3b-a800m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 7

davelsphere/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 5

davelsphere/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 21 • 105

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 21

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 5

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-1b-a400m-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 11

Triangle104/granite-3.0-1b-a400m-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 7

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 5

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 1

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 11

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 16

Triangle104/granite-3.0-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 25 • 11

Triangle104/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 32

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 200

MCZK/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 176

1FriendlyDoge/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 4

farpluto/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 22 • 7

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated Oct 22 • 85

osllmai/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 25 • 74

Esperanto/granite-3.0-2b-instruct-fp16-onnx

Text Generation • Updated 6 days ago • 15

tsalles/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 24 • 8