Spaces:

avanish07
/

sci-mcq-GPT

Runtime error

avanish07 commited on Jul 31, 2023

Commit

3b65e7f

•

1 Parent(s): 8b86d5e

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -38,7 +38,7 @@ model = AutoModelForCausalLM.from_pretrained(
     config.base_model_name_or_path,
     return_dict=True,
     quantization_config=bnb_config,
-    device_map={"cuda:0": "cpu"},
     trust_remote_code=True,
 )
 tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)

     config.base_model_name_or_path,
     return_dict=True,
     quantization_config=bnb_config,
+    device_map=None,
     trust_remote_code=True,
 )
 tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)