THUDM/CogVideoX-5b
Text-to-Video
•
Updated
•
170k
•
517
Xi Yang
ianyeung
·
AI & ML interests
None yet
Recent Activity
liked
a model
about 2 months ago
THUDM/CogVideoX-5b
liked
a model
about 2 months ago
THUDM/CogVideoX-5b-I2V
liked
a model
about 2 months ago
black-forest-labs/FLUX.1-schnell
Organizations
None yet
ianyeung's activity
liked
3
models
about 2 months ago
liked
a
model
4 months ago
liked
a
dataset
5 months ago
liked
2
models
5 months ago
liked
3
models
6 months ago
liked
2
models
7 months ago
liked
a
dataset
8 months ago
liked
2
models
9 months ago
Reacted to
akhaliq's
post with ❤️
9 months ago
Post
PixArt-Σ
Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation (2403.04692)
In this paper, we introduce PixArt-\Sigma, a Diffusion Transformer model~(DiT) capable of directly generating images at 4K resolution. PixArt-\Sigma represents a significant advancement over its predecessor, PixArt-\alpha, offering images of markedly higher fidelity and improved alignment with text prompts. A key feature of PixArt-\Sigma is its training efficiency. Leveraging the foundational pre-training of PixArt-\alpha, it evolves from the
Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation (2403.04692)
In this paper, we introduce PixArt-\Sigma, a Diffusion Transformer model~(DiT) capable of directly generating images at 4K resolution. PixArt-\Sigma represents a significant advancement over its predecessor, PixArt-\alpha, offering images of markedly higher fidelity and improved alignment with text prompts. A key feature of PixArt-\Sigma is its training efficiency. Leveraging the foundational pre-training of PixArt-\alpha, it evolves from the
weaker' baseline to a stronger' model via incorporating higher quality data, a process we term "weak-to-strong training". The advancements in PixArt-\Sigma are twofold: (1) High-Quality Training Data: PixArt-\Sigma incorporates superior-quality image data, paired with more precise and detailed image captions. (2) Efficient Token Compression: we propose a novel attention module within the DiT framework that compresses both keys and values, significantly improving efficiency and facilitating ultra-high-resolution image generation. Thanks to these improvements, PixArt-\Sigma achieves superior image quality and user prompt adherence capabilities with significantly smaller model size (0.6B parameters) than existing text-to-image diffusion models, such as SDXL (2.6B parameters) and SD Cascade (5.1B parameters). Moreover, PixArt-\Sigma's capability to generate 4K images supports the creation of high-resolution posters and wallpapers, efficiently bolstering the production of high-quality visual content in industries such as film and gaming.
liked
4
models
9 months ago
