This repository contains the BitStack-Llama-2-13B model as presented in BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments.

Downloads last month: 8

Safetensors

Model size

26.7B params

Tensor type

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.