Img2Img Batch Processing with ControlNet

Batch Img2Img processing is a popular technique for making video by stitching together frames in ControlNet.

Here is a video explaining how it works:

A video walkthrough
Directories example with Creator's Club in RunDiffusion

Directories

Shared Storage Servers

Your path is located in the Auto1111/paths.txt file. This file will contain your special shared storage file path. It will look something like this:

/mnt/image-storage/c8shs6-sfhe6-88665-sfw7ss3/UPLOADS/batch

In order to upload to this directory, you need to log in through the filebrowser using a new login.

Username: upload
Password: password

This will give you upload permissions to upload your images. Just drop them in.
When you're done you will need to log out and back into your sduser account.

This is a bit of a hack, but it was the quickest way to get this feature pushed out to all the shared storage users.

How to upload for batch img2img
Watch “How to upload for batch img2img” on Streamable.

Note this technique can be used for Deforum init images and videos. Use the same instructions, then reference the path in the Init section like so:

/mnt/image-storage/c8shs6-sfhe6-88665-sfw7ss3/UPLOADS/batch/yourvideo.mp4

or

/mnt/image-storage/c8shs6-sfhe6-88665-sfw7ss3/UPLOADS/batch/yourimage.png

Creators Club Members

Use the /mnt/private/ and then make a directory, like say for example batch-test. In Input Directory, put /mnt/private/batch-test/

In Output Directory, specify another folder.
E.g. /mnt/private/batch-test/output/

Deforum Videos

You can also use this method to upload videos for Deforum processing, see this page:

Uploading Videos for use in Deforum
Creator’s Club Users Use /mnt/private/ and then reference your MP4 video file. So myvideo.mp4 uploaded to the root directory would be /mnt/private/myvideo.mp4 Shared Server Users (No Creator’s Club Subscription) Due to popular demand, we have enabled this feature for our users. It provides tempo…

Stitching together the Video

Use the Deforum tab, and then navigate to "Output". Click "Frames to Video".
This is tricky - reference your original batch output directory, in the example above it's /mnt/private/batch-test/output/

Now, type the first image file name into the field, in the section where it says 09d%, change the 09 to the number of digits your frames have. For example, if you had images called test0001.png, your path would look like the following:

/mnt/private/batch-test/output/test04d%.png

Deflickering

Davinci Resolve (Paid Edition) has a great Deflicker effect. Also Adobe Premiere, RevisionFX and other similar paid tools. There are developers out there actively working on better tools for deflickering in Stable Diffusion, so keep an eye out!

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to RunDiffusion Docs.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.