"triu_tril_cuda_template" not implemented for 'BFloat16'

#19
by als-991011 - opened

how to fix it

File "/usr/local/miniconda3/lib/python3.9/site-packages/transformers/models/qwen2_vl/modeling_qwen2_vl.py", line 428, in _prepare_4d_causal_attention_mask_with_cache_position
causal_mask = torch.triu(causal_mask, diagonal=1)
"triu_tril_cuda_template" not implemented for 'BFloat16'
出现问题

als-991011 changed discussion status to closed

Sign up or log in to comment