TheBloke
/

Llama-2-70B-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama-2-70B-AWQ / config.json

Commit History

Update for Transformers AWQ support

7a10ef7

TheBloke commited on Nov 9, 2023

AWQ model commit

f02f9f6

TheBloke commited on Sep 19, 2023