Post by mauimauricio83 in (Beta) Multi-frame Video rendering for StableDiffusion comments

(Beta) Multi-frame Video rendering for StableDiffusion » Comments

Viewing post in (Beta) Multi-frame Video rendering for StableDiffusion comments

Fantastic tool, Xanthius! After a few hours of tinkering I managed this. Color-Controlnet works really well with your script!

For future updates, is it possible for your script to have batch img2img as part of the process as well?

Xanthius1 year ago

Looks fantastic!

As for the batches, I have been debating how they should work with it. I'm working on a system where you can have it generate multiple versions of each new frame then have it try to pick the best one at each iteration to get better consistency. I believe that would probably be the most useful way to use batch processing for it but it's not quite ready yet.

mauimauricio831 year ago

A content-aware system? Wow, that'd be fantastic. Is that something like what SD/DD Warpfusion does on their implementation, ie optical flow?

Xanthius1 year ago

probably nothing as complex or computationally expensive as that but I'm looking to perhaps use some of the control_net preprocessors to help reduce details like stray hairs from manifesting or disappearing randomly, as well as some color checking to keep color-flickering to a minimum

itch.io

Viewing post in (Beta) Multi-frame Video rendering for StableDiffusion comments