5 ms·

You can only get so far with this, the lighting and perspective won't match and you'll end up with a "collage" look, especially as you add more images. You can

You can only get so far with this, the lighting and perspective won't match and you'll end up with a "collage" look, especially as you add more images. You can sometimes feed the result back through img2img and get it to fix it. Even in an illustrative style like this the color tone is going to look different.

krisoft 4y ago
Sure thing. But I mean it in a much more restrained way. They have one picture where they like the left side of the dock, but say that the AI screwed up the right side. And they have a previous one where the right side is good but the left side is bad. And they are frustrated that the AI can’t or won’t make a single generation where both things are good. And the two pictures have the same structure, same illumination and look barely distinguishable otherwise. That is the case where editing is trivial. You might wonder, how often does this really happen in real life, and the answer is: all the time. You get a picture you like overall, and it looks good from 10 feet distance but on closer inspection you notice some blemishes with it. One way to fix this is to “inpaint” the blemishes. Basically you tell the model to keep all the pixels unchanged, but generate new ones in a small region masking out the blemishes. And of course you run many such inpainting generations and pick the best. And when you have multiple blemishes, which is often the case, then very often one gets filled in good in one generation while the other is better in an other. And you can keep rolling the dice hoping that some day the AI will get it right everywhere, or you can get them in photoshop and do the selection manually.
pjgalbraith 4y ago
Conditioning mask strength helps with this. I did a demonstration in this video https://youtu.be/yUfhvPBURSo https://youtu.be/yUfhvPBURSo
- KolmogorovComp 4y ago
  Nice video. This clearly shows that artists have already tamed the beast and that while spectacular and being a huge time saver, human touch is still needed at all stages.

krisoft 4y ago

Sure thing. But I mean it in a much more restrained way. They have one picture where they like the left side of the dock, but say that the AI screwed up the right side. And they have a previous one where the right side is good but the left side is bad. And they are frustrated that the AI can’t or won’t make a single generation where both things are good. And the two pictures have the same structure, same illumination and look barely distinguishable otherwise. That is the case where editing is trivial. You might wonder, how often does this really happen in real life, and the answer is: all the time. You get a picture you like overall, and it looks good from 10 feet distance but on closer inspection you notice some blemishes with it. One way to fix this is to “inpaint” the blemishes. Basically you tell the model to keep all the pixels unchanged, but generate new ones in a small region masking out the blemishes. And of course you run many such inpainting generations and pick the best. And when you have multiple blemishes, which is often the case, then very often one gets filled in good in one generation while the other is better in an other. And you can keep rolling the dice hoping that some day the AI will get it right everywhere, or you can get them in photoshop and do the selection manually.

pjgalbraith 4y ago

Conditioning mask strength helps with this. I did a demonstration in this video https://youtu.be/yUfhvPBURSo https://youtu.be/yUfhvPBURSo

KolmogorovComp 4y ago
Nice video. This clearly shows that artists have already tamed the beast and that while spectacular and being a huge time saver, human touch is still needed at all stages.