Spaces:

Vision-CAIR
/

MiniGPT-Med

Runtime error

Vision-CAIR commited on Aug 12

Commit

6c45ef3

•

1 Parent(s): 5d798b0

Update minigpt4/models/base_model.py

Files changed (1) hide show

minigpt4/models/base_model.py CHANGED Viewed

@@ -179,7 +179,7 @@ class BaseModel(nn.Module):
                 llama_model_path,
                 torch_dtype=torch.float16,
                 load_in_8bit=True,
-                device_map={'auto': low_res_device}
             )
         else:
             llama_model = LlamaForCausalLM.from_pretrained(

                 llama_model_path,
                 torch_dtype=torch.float16,
                 load_in_8bit=True,
+                device_map={'': low_res_device}
             )
         else:
             llama_model = LlamaForCausalLM.from_pretrained(