Ciara
commited on
Commit
•
721d172
1
Parent(s):
8c65296
Readme
Browse files
README.md
CHANGED
@@ -1,3 +1,21 @@
|
|
1 |
---
|
2 |
license: openrail
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: openrail
|
3 |
---
|
4 |
+
Beta version of TemporalNet, to improve temporal consistency for results like this: https://twitter.com/CiaraRowles1/status/1637486561917906944
|
5 |
+
|
6 |
+
Note: this will not remove all flickering, just reduce it, especially at higher denoise levels.
|
7 |
+
|
8 |
+
The best results will probably be achieved with this and several other methods in conjunction.
|
9 |
+
|
10 |
+
Instructions for Use:
|
11 |
+
|
12 |
+
1) Make a Folder with a folder called "New Folder" containing the input frames, a png called init.png that is already stylized in the style you want and the temporalvideo.py script.)
|
13 |
+
2) modify the temporalvideo.py script with any changes you want, i.e the resolution for the image, the prompt and the controlnet settings.
|
14 |
+
3) Run Automatic1111s Web UI with the --api setting enabled.
|
15 |
+
4) Run the python script.
|
16 |
+
|
17 |
+
Note: The init image will not significantly affect the style of the output video, it's just to ensure there isn't a big jump in aesthetic over the first few frames.
|
18 |
+
|
19 |
+
ToDo:
|
20 |
+
1) Write an extension to work with this so you can just use it out of the web ui.
|
21 |
+
2) Add functionality so the init image will auto-generate if none is provided.
|