aifoundry-org
/

OLMo-1B-0724-hf-Quantized

Text2Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Quantized versions of https://huggingface.co/allenai/OLMo-1B-0724-hf

Quantized with this tool: https://github.com/aifoundry-org/LlamaQuantizer

Downloads last month: 129

GGUF

Model size

1.28B params

Architecture

olmo

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Text2Text Generation

Unable to determine this model's library. Check the docs .

Model tree for aifoundry-org/OLMo-1B-0724-hf-Quantized

Base model

allenai/OLMo-1B-0724-hf

Quantized

(4)

this model