LaCon / README.md
AlonzoLeeeooo's picture
Update basic descriptions
5f70e6b verified
|
raw
history blame
1.91 kB
---
license: mit
---
<div align="center">
# LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis
Chang Liu, Rui Li, Kaidong Zhang, Xin Luo, Dong Liu
[[`Paper`]]((https://arxiv.org/pdf/2305.11520)) / [[`GitHub`]](https://github.com/AlonzoLeeeooo/LCDG) / [[`Project`]](https://alonzoleeeooo.github.io/LCDG/) / [[`Model Weights`]](https://huggingface.co/AlonzoLeeeooo/LaCon) / [`Demo`]
</div>
Official pre-trained model weights of the paper titled "LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis".
# Model Weights Structure
```
LaCon/
└── data-preprocessing
β”œβ”€β”€ bdcn.pth <----- Model weights of BDCN edge detector (Place in `data-preprocessing/bdcn-edge-detection/checkpoints`)
β”œβ”€β”€ vgg16.pth <----- Preresquisites of BDCN edge detector (Place in `data-preprocessing/bdcn-edge-detection/checkpoints`)
└── u2net.pth <----- Model weights of U2-Net saliency detector (Place in `data-preprocessing/u2net-saliency-detection/checkpoints`)
└── sd-checkpoints
β”œβ”€β”€ sd-v1-4.ckpt <----- SD v1.4
β”œβ”€β”€ kl-f8.ckpt <----- VAE model of SD v1.4
β”œβ”€β”€ sd-celebahq.ckpt <----- SD CelebA-HQ
└── vq-f4.ckpt <----- VAE model of SD CelebA-HQ
β”œβ”€β”€ sdv14_edge.pth <----- Condition aligner based on SD v1.4, for edge conditions
β”œβ”€β”€ sdv14_color.pth <----- Condition aligner based on SD v1.4, for color conditions
β”œβ”€β”€ sdv14_mask.pth <----- Condition aligner based on SD v1.4, for mask conditions
β”œβ”€β”€ sd_celeb_edge.pth <----- Condition aligner based on SD CelebA-HQ, for edge conditions
└── sd_celeb_stroke.pth <----- Condition aligner based on SD CelebA-HQ, for color conditions