a-r-r-o-w HF staff commited on
Commit
7a1a731
1 Parent(s): 66fae7d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - Wild-Heart/Disney-VideoGeneration-Dataset
4
+ base_model:
5
+ - THUDM/CogVideoX-5b
6
+ pipeline_tag: text-to-video
7
+ library_name: diffusers
8
+ tags:
9
+ - text-to-video
10
+ - diffusers-training
11
+ - diffusers
12
+ - lora
13
+ - cogvideox
14
+ - cogvideox-diffusers
15
+ - template:sd-lora
16
+ ---
17
+ # CogVideoX LoRA - {repo_id}
18
+
19
+ <Gallery />
20
+
21
+ ## Model description
22
+
23
+ These are `a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003` LoRA weights for `THUDM/CogVideoX-5b`.
24
+
25
+ The weights were trained using the [CogVideoX Diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/cogvideo/train_cogvideox_lora.py).
26
+
27
+ Was LoRA for the text encoder enabled? No.
28
+
29
+ ## Download model
30
+
31
+ [Download the *.safetensors LoRA](a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003/tree/main) in the Files & versions tab.
32
+
33
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
34
+
35
+ ```py
36
+ from diffusers import CogVideoXPipeline
37
+ import torch
38
+
39
+ pipe = CogVideoXPipeline.from_pretrained("THUDM/CogVideoX-5b", torch_dtype=torch.bfloat16).to("cuda")
40
+ pipe.load_lora_weights("a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003", weight_name="pytorch_lora_weights.safetensors", adapter_name=["cogvideox-lora"])
41
+ pipe.set_adapters(["cogvideox-lora"], [1.0])
42
+
43
+ video = pipe("BW_STYLE A black and white animated scene unfolds with an anthropomorphic goat surrounded by musical notes and symbols, suggesting a playful environment. Mickey Mouse appears, leaning forward in curiosity as the goat remains still. The goat then engages with Mickey, who bends down to converse or react. The dynamics shift as Mickey grabs the goat, potentially in surprise or playfulness, amidst a minimalistic background. The scene captures the evolving relationship between the two characters in a whimsical, animated setting, emphasizing their interactions and emotions", guidance_scale=6, use_dynamic_cfg=True).frames[0]
44
+ ```
45
+
46
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
47
+
48
+ ## License
49
+
50
+ Please adhere to the licensing terms as described [here](https://huggingface.co/THUDM/CogVideoX-5b/blob/main/LICENSE) and [here](https://huggingface.co/THUDM/CogVideoX-2b/blob/main/LICENSE).