Spaces:

vishwask
/

witp_poc

Running

vishwask commited on Sep 14, 2023

Commit

67f5de2

1 Parent(s): a08a5ef

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -86,7 +86,7 @@ def load_model():
     model = AutoGPTQForCausalLM.from_quantized(
         model_name_or_path,
-        revision="gptq-4bit-128g-actorder_False",
         model_basename=model_basename,
         use_safetensors=True,
         trust_remote_code=True,

     model = AutoGPTQForCausalLM.from_quantized(
         model_name_or_path,
+        revision="gptq-8bit-128g-actorder_False",
         model_basename=model_basename,
         use_safetensors=True,
         trust_remote_code=True,