OpenGVLab
/

Mono-InternVL-2B

Image-Text-to-Text

feature-extraction

Mixture of Experts

Model card Files Files and versions Community

Update README.md

#4

by douwh - opened Oct 10

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -180,7 +180,6 @@ model = AutoModel.from_pretrained(
     path,
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
-    use_flash_attn=True,
     trust_remote_code=True).eval().cuda()
 tokenizer = AutoTokenizer.from_pretrained(path, trust_remote_code=True, use_fast=False)

     path,
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     trust_remote_code=True).eval().cuda()
 tokenizer = AutoTokenizer.from_pretrained(path, trust_remote_code=True, use_fast=False)