Hugging Face's logo

Qwen
/
Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text
Safetensors
English
qwen2_vl
multimodal
conversational
4-bit precision
gptq
Model card Files Community
1
New discussion

Any one can use VLLM or any other engine support dynamic batch to run this with more than 1 GPU?

1
#1 opened 2 months ago by bash99