metadata

base_model:
  - tencent/HunyuanVideo
tags:
  - LoRA
  - hunyuan

Arcane Jinx HunyuanVideo LoRA v1

Prompt: "CSETIARCANE. The video is focusing on girl with blue hair. Her expression transitions subtly across the frames, starting from a somber or contemplative look and progressing to one that appears more engaged or possibly surprised. The lighting is dim and moody, emphasizing shadows and creating a dramatic effect around the character's features. The background remains consistently dark throughout the sequence, ensuring the focus stays solely on the character's changing expressions."

Important Notes:

This LoRA is created as part of a fan project for research purposes only and is not intended for commercial use. It is based on the TV series called Arcane which are protected by copyright. Users utilize the model at their own risk. Users are obligated to comply with copyright laws and applicable regulations. The model has been developed for non-commercial purposes, and it is not my intention to infringe on any copyright. I assume no responsibility for any damages or legal consequences arising from the use of the model.

Compatibility:

HunyuanVideo

ID Token / Trigger word(s):

Use these in your prompt helps providing the character. See example prompt above.

csetiarcane, nfjinx, blue hair, black top

Please consider the following:

If it doesn't produce the character, try increasing the lora strength to 1.2
With some seeds it doesn't work well, it simply doesn't produce either the style or the character
I definitely recommend using at least the following trigger words in your prompt: 'csetiarcane, nfjinx, blue hair' .This is probably due to how the dataset was assembled, I'd like to fix this in later versions"

Acknowledgment:

Thanks to the Tencent team for making this great model available
Thanks to tdrussel for the diffusion-pipe that helps us making these LoRAs.
Thanks to Kijai for his great ComfyUI integration
Thanks to POM for providing the computing resources. Without this, these LoRAs could not have been created.

Trainig details:

LR: 2e-5
Optimizer: adamw
steps: 6000
dataset: 40 (33x704x352) videos
rank: 32
batch size: 1
gradient accumulation steps: 4

Citation

@misc{kong2024hunyuanvideo,
      title={HunyuanVideo: A Systematic Framework For Large Video Generative Models}, 
      author={Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, Kathrina Wu, Qin Lin, Aladdin Wang, Andong Wang, Changlin Li, Duojun Huang, Fang Yang, Hao Tan, Hongmei Wang, Jacob Song, Jiawang Bai, Jianbing Wu, Jinbao Xue, Joey Wang, Junkun Yuan, Kai Wang, Mengyang Liu, Pengyu Li, Shuai Li, Weiyan Wang, Wenqing Yu, Xinchi Deng, Yang Li, Yanxin Long, Yi Chen, Yutao Cui, Yuanbo Peng, Zhentao Yu, Zhiyu He, Zhiyong Xu, Zixiang Zhou, Zunnan Xu, Yangyu Tao, Qinglin Lu, Songtao Liu, Daquan Zhou, Hongfa Wang, Yong Yang, Di Wang, Yuhong Liu, and Jie Jiang, along with Caesar Zhong},
      year={2024},
      archivePrefix={arXiv preprint arXiv:2412.03603},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2412.03603}, 
}