4 ms·
This is really interesting. Another thing I noticed in my fun with SD is that it is extremely stubborn about colors during the denoising process. That is, what
by 2bitencryption 4y ago
This is really interesting. Another thing I noticed in my fun with SD is that it is extremely stubborn about colors during the denoising process.
That is, whatever color a region of the image has during denoising step 3, it will almost surely have that color at step 50, even if it makes no logical sense for the thing in that location to have that color.
This may not seem bad, but it's annoying when doing anything image-to-image, because regardless of the prompt you give it, the colors are "sticky".
If you have an image of an apple, and you use image-to-image with the prompt "an image of an orange", you will get a very reddish orange (in my experience at least).
- markisus 4y agoThis could possibly be fixed by generating training image sequences which, along with random noise pixes, also have random hue shift for subregions of the image.
- sp332 4y agoDoes it work to make a greyscale image and let the denoiser find a color by descent?
- danielvf 4y agoFrom experience in related things - you are going to get a fairly grey orange, and fairly grey overall image.
- Vecr 4y agoI've heard putting a fuzzy multicolored noise (perlin in RGB space or something) over your IMG2IMG input. Not sure what scale or what opacity you need, but that's something you can try.
- CuriouslyC 4y agoYou can use this to your advantage too though. I've manually generated "noise" for img2img by taking a base image, hitting it with a bunch of filters, then putting it back into img2img with a low-ish denoising strength. This method works quite well for ensuring composition while still letting the image be styled, but it's probably obsolete for that purpose now that we have controlnet.