BitStack
/

BitStack-Llama-3-70B

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

BitStack-Llama-3-70B / README.md

Singhoo's picture

Create README.md

9c60408 verified 2 months ago

|

256 Bytes

metadata

library_name: transformers

This repository contains the BitStack-Llama-3-70B model as presented in BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments.