csdc-atl
/

buffer-baichuan2-13B-rag-awq-int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

buffer-baichuan2-13B-rag-awq-int4 / generation_utils.py

Commit History

awq version for baichuan2 rag enhance

2f58c6c

oilpig commited on Dec 17, 2023