CalamitousFelicitousness
/

Qwen2-VL-72B-Instruct-GPTQ-Int4-tpfix

Image-Text-to-Text

4-bit precision

Model card Files Files and versions Community

CalamitousFelicitousness commited on Sep 22

Commit

2014bda

•

1 Parent(s): 6ac3d69

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -10,6 +10,8 @@ tags:
 base_model: Qwen/Qwen2-VL-72B-Instruct
 ---
 # Qwen2-VL-72B-Instruct-GPTQ-Int4
 ## Introduction

 base_model: Qwen/Qwen2-VL-72B-Instruct
 ---
+# This repo contains a fix for intermediate_size which was incompatible with VLLM parallel inference.
 # Qwen2-VL-72B-Instruct-GPTQ-Int4
 ## Introduction