ImportError: This modeling file requires the following packages that were not found in your environment: flash_attn. Run `pip install flash_attn`

#14
by kang1 - opened

This is a common issue in transformers when model trust_remote_code=True, some discussion in https://github.com/huggingface/transformers/issues/28459

The problem is transformers' dynamic module implemetation, maybe deepseek2 can apply this fix:
https://huggingface.co/microsoft/phi-2/commit/eb8bbd1d37d258ea74fb082c53346d33056a83d4

Sign up or log in to comment