Qwen
/

Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

missing quantize_config.json file

#4 opened 7 months ago by

[AUTOMATED] Model Memory Requirements

#3 opened 8 months ago by

model-sizer-bot

segmentation fault. Any code including the sample provided.

#2 opened 9 months ago by