Binarybardakshat commited on
Commit
d55b827
1 Parent(s): 484f391

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md CHANGED
@@ -34,6 +34,36 @@ RCNA MINI is based on the LoRA architecture, which fine-tunes diffusion models u
34
  - **Architecture**: LoRA applied to diffusion models
35
  - **Inference Steps**: 4-step generation
36
  - **Output Length**: 4 to 16 seconds
 
 
37
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
  ## License:
39
  This model is licensed under the [MIT License](LICENSE).
 
34
  - **Architecture**: LoRA applied to diffusion models
35
  - **Inference Steps**: 4-step generation
36
  - **Output Length**: 4 to 16 seconds
37
+ -
38
+ ## Using AnimateLCM with Diffusers
39
 
40
+ ```python
41
+ import torch
42
+ from diffusers import AnimateDiffPipeline, LCMScheduler, MotionAdapter, DiffusionPipeline
43
+ from diffusers.utils import export_to_gif
44
+
45
+ # Load AnimateLCM for video generation
46
+ adapter = MotionAdapter.from_pretrained("Binarybardakshat/RCNA_MINI")
47
+ pipe = AnimateDiffPipeline.from_pretrained("emilianJR/epiCRealism", motion_adapter=adapter, torch_dtype=torch.float16)
48
+ pipe.scheduler = LCMScheduler.from_config(pipe.scheduler.config, beta_schedule="linear")
49
+ pipe.load_lora_weights("Binarybardakshat/RCNA_MINI", weight_name="RCNA_LORA_MINI_1.safetensors", adapter_name="lcm-lora")
50
+ pipe.set_adapters(["lcm-lora"], [0.8])
51
+ pipe.enable_vae_slicing()
52
+ pipe.enable_model_cpu_offload()
53
+
54
+ # Generate video using RCNA MINI
55
+ output = pipe(
56
+ prompt="A space rocket with trails of smoke behind it launching into space from the desert, 4k, high resolution",
57
+ negative_prompt="bad quality, worse quality, low resolution",
58
+ num_frames=16,
59
+ guidance_scale=2.0,
60
+ num_inference_steps=6,
61
+ generator=torch.Generator("cpu").manual_seed(0),
62
+ )
63
+ frames = output.frames[0]
64
+ export_to_gif(frames, "animatelcm.gif")
65
+ print("Video and image generation complete!")
66
+
67
+ ```
68
  ## License:
69
  This model is licensed under the [MIT License](LICENSE).