CalamitousFelicitousness
/

Qwen2-VL-72B-Instruct-tpfix

Image-Text-to-Text

Inference Endpoints

Model card Files Files and versions Community

CalamitousFelicitousness commited on Sep 22

Commit

30adf74

•

1 Parent(s): 8749c5d

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -9,6 +9,7 @@ tags:
 - multimodal
 library_name: transformers
 ---
 # Qwen2-VL-72B-Instruct

 - multimodal
 library_name: transformers
 ---
+# This repo contains a fix for intermediate_size which was incompatible with VLLM parallel inference. This repo will allow you to run with tensor_parallel of 2.
 # Qwen2-VL-72B-Instruct