TheBloke
/

Falcon-7B-Instruct-GPTQ

Text Generation

RefinedWebModel

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Falcon-7B-Instruct-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

d6ce55f

TheBloke commited on Aug 21, 2023

Initial AutoGPTQ model commit.

ded9ab7

TheBloke commited on May 27, 2023