Img2Img takes an existing image, and reimagines it using Stable Diffusion. This can be great for remixing existing photos, or changing them to bring it closer to your creative vision.
Settings:
Many here are the same as Txt2Img, so we will focus on what is new.
Resize Mode
- Just Resize - this will resize your image to meet the width / height set
- Crop and Resize - this will crop the image to the set resolution and and then diffuse the image
- Resize and fill - resizes the image, fills empty space with images colors
- Just Resize (Latent Upscale) - latent space is an abstract space that contains an interpretation of the observed events. You could even say individual perceptions of humans are in a latent space, although some camps disagree and think our direct perception is reality. Lots of philosophical arguments are about this. Anyways, I digress... in Stable Diffusion, latent space is the image representation space learned by the encoder in training. This option will resize and use it's interpretation of the image to upscale. Pretty cool, huh?
Denoising Strength
Denoising Strength determines how much diffusion will change the original image. A high denoising strength will completely replace the image and a low denoising strength will keep the original image intact. Everything in between will slowly introduce more of the diffusion into the mix. This can be useful in inpainting, but also for making slight changes or drastic ones.
Batch Processing
Batch processing is a great way to process a number of images in a directory. Using controlnet you can even create creative videos by processing every frame.
Batch processing requires private storage with our Creators Club subscription. You then create a folder, and reference that folder in the Input directory. Your root directory in Creator's Club is /mnt/private/
For more information on Batch Processing in Creator's Club, including how to make ControlNet Img2Img videos, check
Ultimate Upscale
It's best not to use Euler A, try to keep a less dynamic sampler. Use a redraw option to give a broad idea of the upscale, then Ultimate upscaler will break into tiles and upscale each one. You can change the tile size, and the tile amount (Starts with "M" in first row of settings, with number 12).
Seams fix will reduce the amount of generation between the tiles, padding can help with this as well.
Set the img2img resolution will be used to determine the final resolution of the image. The ultimate upscaler settings will determine how it gets to that resolution.
Inpainting
Use this tab to replace portions of an image. You can also use it for outpainting.
With inpainting, you can draw on your canvas and mask the area you wish to replace. Write in a prompt that contains the existing prompt you used for your image, but tweak it to generate what you want to inpaint. "Inpaint masked" will replace the area that you have drawn on the canvas. If you keep the masked area option on "Original" it will keep the image you had already underneath the mask.
Try creating larger batches and then determining which replacement you want to use. Crop and resize is usually a good idea when working on an upscaled image, as it will reduce the size. Working with the original size of the model, aka 512 or 768 is best. That being said - try it all!
