metadata

license: gpl-3.0
language:
  - en
tags:
  - magicdrive
  - video-generation
  - autonomous-driving

MagicDriveDiT

📄 Paper | 🌐 Website | 📖 LICENSE | 🤖 GitHub

This repository contains the model checkpoint of the paper.

This model is fine-tuned for 10k steps with lr=1e-5 after 40k steps of training for stage-3.

Note:

For inference/testing, we recommend the ema model, i.e., ema.pt.
For fine-tuning, you can consider to use the training checkpoint, i.e., model/*

MagicDriveDiT: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control
Ruiyuan Gao¹, Kai Chen², Bo Xiao³, Lanqing Hong⁴, Zhenguo Li⁴, Qiang Xu¹
¹CUHK ²HKUST ³Huawei Cloud ⁴Huawei Noah's Ark Lab

Please find more information on our GitHub: https://github.com/flymin/MagicDriveDiT