Please either use vicuna-7B-1.1-GPTQ-4bit-128g.no-act-order.pt, or else update GPTQ-for-LLaMa. Details are in the README.
vicuna-7B-1.1-GPTQ-4bit-128g.no-act-order.pt
· Sign up or log in to comment