Duplicate from nunchaku-tech/nunchaku-qwen-image-edit-2509

Co-authored-by: Muyang Li <Lmxyy@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,91 @@
+---
+base_model: Qwen/Qwen-Image-Edit-2509
+base_model_relation: quantized
+datasets:
+- mit-han-lab/svdquant-datasets
+language:
+- en
+library_name: diffusers
+license: apache-2.0
+pipeline_tag: text-to-image
+tags:
+- image-editing
+- SVDQuant
+- Qwen-Image-Edit-2509
+- Diffusion
+- Quantization
+- ICLR2025
+
+---
+<p align="center" style="border-radius: 10px">
+  <img src="https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/nunchaku/assets/nunchaku.svg" width="30%" alt="Nunchaku Logo"/>
+</p>
+
+<div align="center">
+  <a href=https://discord.gg/Wk6PnwX9Sm target="_blank"><img src=https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fdiscord.com%2Fapi%2Finvites%2FWk6PnwX9Sm%3Fwith_counts%3Dtrue&query=%24.approximate_member_count&logo=discord&logoColor=white&label=Discord&color=green&suffix=%20total height=22px></a>
+  <a href=https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/nunchaku/assets/wechat.jpg target="_blank"><img src=https://img.shields.io/badge/WeChat-07C160?logo=wechat&logoColor=white height=22px></a>
+</div>
+
+# Model Card for nunchaku-qwen-image-edit-2509
+
+![visual](https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/ComfyUI-nunchaku/workflows/nunchaku-qwen-image-edit-2509.png)
+This repository contains Nunchaku-quantized versions of [Qwen-Image-Edit-2509](https://huggingface.co/Qwen/Qwen-Image-Edit-2509), an image-editing model based on [Qwen-Image](https://huggingface.co/Qwen/Qwen-Image), advances in complex text rendering. It is optimized for efficient inference while maintaining minimal loss in performance.
+
+## News
+
+- [2025-09-25] 🔥 Release **4-bit [4/8-step lightning Qwen-Image-Edit](https://huggingface.co/lightx2v/Qwen-Image-Lightning)**!
+- [2025-09-24] 🚀 Release 4-bit SVDQuant quantized Qwen-Image-Edit-2509 model with rank 32 and 128!
+
+
+## Model Details
+
+### Model Description
+
+- **Developed by:** Nunchaku Team
+- **Model type:** image-to-image
+- **License:** apache-2.0
+- **Quantized from model:** [Qwen-Image-Edit-2509](https://huggingface.co/Qwen/Qwen-Image-Edit-2509)
+
+### Model Files
+
+- [`svdq-int4_r32-qwen-image-edit-2509.safetensors`](./svdq-int4_r32-qwen-image-edit-2509.safetensors): SVDQuant INT4 (rank 32) Qwen-Image-Edit-2509 model. For users with non-Blackwell GPUs (pre-50-series).
+- [`svdq-int4_r128-qwen-image-edit-2509.safetensors`](./svdq-int4_r128-qwen-image-edit-2509.safetensors): SVDQuant INT4 (rank 128) Qwen-Image-Edit-2509 model. For users with non-Blackwell GPUs (pre-50-series). It offers better quality than the rank 32 model, but it is slower.
+- [`svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors`](./svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors): SVDQuant INT4 (rank 32) 4-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
+- [`svdq-int4_r128-qwen-image-edit-2509-lightning`](./svdq-int4_r128-qwen-image-edit-2509-lightning): SVDQuant INT4 (rank 128) 4-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
+- [`svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors`](./svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors): SVDQuant INT4 (rank 32) 8-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
+- [`svdq-int4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors`](./svdq-int4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors): SVDQuant INT4 (rank 128) 8-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
+- [`svdq-fp4_r32-qwen-image-edit-2509.safetensors`](./svdq-fp4_r32-qwen-image-edit-2509.safetensors): SVDQuant NVFP4 (rank 32) Qwen-Image-Edit-2509 model. For users with Blackwell GPUs (50-series).
+- [`svdq-fp4_r128-qwen-image-edit-2509.safetensors`](./svdq-fp4_r128-qwen-image-edit-2509.safetensors): SVDQuant NVFP4 (rank 128) Qwen-Image-Edit-2509 model. For users with Blackwell GPUs (50-series). It offers better quality than the rank 32 model, but it is slower.
+- [`svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors`](./svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors): SVDQuant NVFP4 (rank 32) 4-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
+- [`svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-4steps.safetensors`](./svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-4steps.safetensors): SVDQuant NVFP4 (rank 128) 4-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-4steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
+- [`svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors`](./svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors): SVDQuant NVFP4 (rank 32) 8-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
+- [`svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors`](./svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors): SVDQuant NVFP4 (rank 128) 8-step Qwen-Image-Edit-2509 model by fusing [Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors](https://huggingface.co/lightx2v/Qwen-Image-Lightning/blob/main/Qwen-Image-Lightning-8steps-V2.0-bf16.safetensors) using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
+
+
+### Model Sources
+
+- **Inference Engine:** [nunchaku](https://github.com/nunchaku-tech/nunchaku)
+- **Quantization Library:** [deepcompressor](https://github.com/nunchaku-tech/deepcompressor)
+- **Paper:** [SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models](http://arxiv.org/abs/2411.05007)
+- **Demo:** [svdquant.mit.edu](https://svdquant.mit.edu)
+
+## Usage
+
+- Diffusers Usage: See [qwen-image-edit-2509.py](https://github.com/nunchaku-tech/nunchaku/blob/main/examples/v1/qwen-image-edit-2509.py). Check this [tutorial](https://nunchaku.tech/docs/nunchaku/usage/qwen-image-edit.html) for more advanced usage.
+- ComfyUI Usage: See [nunchaku-qwen-image-edit-2509.json](https://nunchaku.tech/docs/ComfyUI-nunchaku/workflows/qwenimage.html#nunchaku-qwen-image-edit-2509-json).
+
+## Performance
+
+![performance](https://huggingface.co/datasets/nunchaku-tech/cdn/resolve/main/nunchaku/assets/efficiency.jpg)
+
+## Citation
+
+```bibtex
+@inproceedings{
+  li2024svdquant,
+  title={SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models},
+  author={Li*, Muyang and Lin*, Yujun and Zhang*, Zhekai and Cai, Tianle and Li, Xiuyu and Guo, Junxian and Xie, Enze and Meng, Chenlin and Zhu, Jun-Yan and Han, Song},
+  booktitle={The Thirteenth International Conference on Learning Representations},
+  year={2025}
+}
+```

svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-4steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d1e939d26170fed8dd0e0327f8a78ff2e48cbd87d29d7a54c0e887625dc12e3
+size 13081386856

svdq-fp4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc326ac54b247aea704c6cc47492cf68e5c85c937d50e5afcc9638fbdeeabcb3
+size 13081386856

svdq-fp4_r128-qwen-image-edit-2509.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33da928d732cfe242d899b17256538dca5b08f4da90976984819ffec444b06f3
+size 13081386856

svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd58dea58814f546e3ba5e13af072d353bb2276525564bf49337c5cd506cf9be
+size 11948923656

svdq-fp4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7da9583a76f62028f70054f78303127bb5d629ce253661c5afaf2f9c480b43ee
+size 11948923656

svdq-fp4_r32-qwen-image-edit-2509.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d6f4684e2e89bf22480019e773108de129c22694f0314d2bca00e3d60ed8c031
+size 11948923656

svdq-int4_r128-qwen-image-edit-2509-lightningv2.0-4steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec63cbacb29d80264a786f21f7b4b26f19147b3bdb25895966906d78bde0473b
+size 12654443144

svdq-int4_r128-qwen-image-edit-2509-lightningv2.0-8steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0e1f4c67010059e210b7cedb4b967179280e3e040e676292206b0dbb7af1e50
+size 12654443144

svdq-int4_r128-qwen-image-edit-2509.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09360052af6777fd36623b7f3604b67ae0f93323b0e46eab92490acb4159eabd
+size 12654443144

svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-4steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d995e64c2df2b0573fb5752c5b29160b826e60dc61dd57a2b8c30f9e17ad22b4
+size 11521979944

svdq-int4_r32-qwen-image-edit-2509-lightningv2.0-8steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a57562dc37c32c97d0cef154dd6f181313b4769efd1549b1df9acd6bac3e7cb
+size 11521979944

svdq-int4_r32-qwen-image-edit-2509.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3a99e3ca15328127f95eda4082875f0b47d2f1e0058eb390f9f8ecaa6196180
+size 11521979944