itch.io

You can check my video:

sxy9699 said:

I found an easy way to solve this problem: simply change the code in multi_frame_render.py

        reference_imgs = gr.UploadButton(label="Upload Guide Frames", file_types = ['.png','.jpg','.jpeg'], live=True, file_count = "multiple") 

to

reference_imgs = gr.File(file_count="directory", label="Upload Guide Frames", show_label=True)

Denoising strength should be around 1.

check this vid:

Is the "Allow other script to control this extension" setting in ControlNET ON? Show us your settings in the img2img tab.

I discovered that removing the background helps with maintaining consistency. I'm using this extension:

https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg

A short video about it:

Quick tutorial about the script:

That was it! Thank you very much!

Sorry, I didn't specify. The background is not a problem. The face is not moving no matter what is on the source video

Thank you for your fast response. I tride different ControlNet models (canny, hed, depth, normal), weight (0.3,0.5,0.9 or even 1.6), preprocessor on/off and 3 sets of guide frames with no luck. Only this happens:

Looks great! I follow your instructions but only background is changing. What coluld be the problem?