metadata
license: openrail
Beta version of TemporalNet, to improve temporal consistency for results like this: https://twitter.com/CiaraRowles1/status/1637486561917906944
Note: this will not remove all flickering, just reduce it, especially at higher denoise levels.
The best results will probably be achieved with this and several other methods in conjunction.
Instructions for Use:
- Make a Folder with a folder called "New Folder" containing the input frames, a png called init.png that is already stylized in the style you want and the temporalvideo.py script.)
- modify the temporalvideo.py script with any changes you want, i.e the resolution for the image, the prompt and the controlnet settings.
- Run Automatic1111s Web UI with the --api setting enabled.
- Run the python script.
Note: The init image will not significantly affect the style of the output video, it's just to ensure there isn't a big jump in aesthetic over the first few frames.
ToDo:
- Write an extension to work with this so you can just use it out of the web ui.
- Add functionality so the init image will auto-generate if none is provided.