aifoundry-org
/

OLMo-7B-0724-Instruct-hf-Quantized

Text2Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Quantized versions of https://huggingface.co/allenai/OLMo-7B-0724-Instruct-hf

Quantized with this tool: https://github.com/aifoundry-org/LlamaQuantizer

Downloads last month: 102

GGUF

Model size

6.89B params

Architecture

olmo

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Text2Text Generation

Unable to determine this model's library. Check the docs .

Model tree for aifoundry-org/OLMo-7B-0724-Instruct-hf-Quantized

Base model

allenai/OLMo-7B-0724-Instruct-hf

Quantized

(7)

this model