Qwen2.5-32B-8bpw-EXL2 / README.md

altomek

quants upload

5a7f698 verified about 2 months ago

preview code

raw

history blame contribute delete

272 Bytes

metadata

license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2.5-32B/blob/main/LICENSE
language:
  - en
pipeline_tag: text-generation
inference: false
base_model: Qwen/Qwen2.5-32B

Qwen2.5-32B

ExLlamav2 8 bpw quant of https://huggingface.co/Qwen/Qwen2.5-32B