Granite 3.3 8b Instruct FP8

This repository contains the FP8 version of Granite-3.3-8b-Instruct.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-instruct

Downloads last month: 80

Safetensors

Model size

8B params

Tensor type

BF16

F8_E4M3

Model tree for ibm-granite/granite-3.3-8b-instruct-FP8

Base model

ibm-granite/granite-3.3-8b-base

Finetuned

ibm-granite/granite-3.3-8b-instruct

Quantized

(33)

this model

Collection including ibm-granite/granite-3.3-8b-instruct-FP8

Granite Quantized Models

Collection

Quantized versions of IBM Granite models. Licensed under the Apache 2.0 license. • 41 items • Updated 1 day ago • 20