Transformers How to use nesty/sg-bart-large-4096-gptq-2bit with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("nesty/sg-bart-large-4096-gptq-2bit", trust_remote_code=True)
model = AutoModelForSeq2SeqLM.from_pretrained("nesty/sg-bart-large-4096-gptq-2bit", trust_remote_code=True) 
