unsloth/granite-4.0-h-small-GGUF
32B
•
Updated
•
65.1k
•
34
Granite 4.0
IBM's new Granite-4.0 models! Run Dynamic GGUFs or fine-tune with Unsloth.
Note Unsloth Dynamic GGUFs to run:
-
unsloth/granite-4.0-h-tiny-GGUF
7B • Updated • 34.4k • 24 -
unsloth/granite-4.0-h-micro-GGUF
3B • Updated • 15.6k • 12 -
unsloth/granite-4.0-micro-GGUF
3B • Updated • 7.55k • 9
unsloth/granite-4.0-h-small-unsloth-bnb-4bit
Text Generation • 32B • Updated • 333 • 3Note Unsloth Dynamic 4-bit BitsandBytes to fine-tune/deploy:
-
unsloth/granite-4.0-h-micro-unsloth-bnb-4bit
Text Generation • 3B • Updated • 1.63k • 2 -
unsloth/granite-4.0-micro-unsloth-bnb-4bit
Text Generation • 3B • Updated • 1.14k • 3 -
unsloth/granite-4.0-micro-base-unsloth-bnb-4bit
Text Generation • 3B • Updated • 105 • 1
unsloth/granite-4.0-h-small
Text Generation • 32B • Updated • 3.74k • 3Note Original 16-bit safetensors to fine-tune/deploy:
-
unsloth/granite-4.0-h-tiny
Text Generation • 7B • Updated • 4.23k • 4 -
unsloth/granite-4.0-h-micro
Text Generation • 3B • Updated • 3.89k • 2 -
unsloth/granite-4.0-micro
Text Generation • 3B • Updated • 1.42k • 2
unsloth/granite-4.0-h-small-FP8-Dynamic
Text Generation • 33B • Updated • 657 • 3Note FP8 Dynamic quants to serve/deploy:
-
unsloth/granite-4.0-h-tiny-FP8-Dynamic
Text Generation • 7B • Updated • 803
unsloth/granite-4.0-h-small-bnb-4bit
Text Generation • 32B • Updated • 201 • 2Note 4-bit BitsandBytes to fine-tune/deploy:
-
unsloth/granite-4.0-h-micro-bnb-4bit
Text Generation • 3B • Updated • 222 • 3 -
unsloth/granite-4.0-micro-base-bnb-4bit
Text Generation • 4B • Updated • 87 • 1 -
unsloth/granite-4.0-h-micro-base-bnb-4bit
Text Generation • 3B • Updated • 15 • 1 -
unsloth/granite-4.0-micro-base
Text Generation • 3B • Updated • 241 • 2 -
unsloth/granite-4.0-h-micro-base
Text Generation • 3B • Updated • 148 • 1 -
unsloth/granite-4.0-h-micro-base-unsloth-bnb-4bit
Text Generation • 3B • Updated • 472 -
unsloth/granite-4.0-h-small-base
32B • Updated • 93 -
unsloth/granite-4.0-h-tiny-base
Text Generation • 7B • Updated • 288