4 ms·
> "can you give the bear a red cap" That's exactly what DALL·E2 is already capable of. You can paint over a region of the image and tell it what you want in th
by grumbel 4y ago
> "can you give the bear a red cap"
That's exactly what DALL·E2 is already capable of. You can paint over a region of the image and tell it what you want in that area:
https://youtu.be/qTgPSKKjfVg?t=77 https://youtu.be/qTgPSKKjfVg?t=77
You can even use this in-painting ability to enlarge images. For example you can feed it this:
https://preview.redd.it/z7y2tbwjtny81.jpg?width=680&auto=webp&s=e3fa6a1760a58ee3d8275d3fd0bf8036dcd614df https://preview.redd.it/z7y2tbwjtny81.jpg?width=680&auto=web...
And turn it into this:
https://i.imgur.com/Zp4MWXX.jpg https://i.imgur.com/Zp4MWXX.jpg
https://i.imgur.com/xsEydvk.jpg https://i.imgur.com/xsEydvk.jpg
Source: https://old.reddit.com/r/dalle2/comments/umk5vw/science_fiction_futuristic_dystopian_nun/ https://old.reddit.com/r/dalle2/comments/umk5vw/science_fict...
And also worth mentioning that each of those iteration only takes like 10sec, not days or weeks as with a real artist.
The one thing DALL·E2 is however missing is being specific, you can tell it to draw SuperMario and it will come up with something that looks like somewhat like SuperMario, but it is taking a lot of creative freedom along the way. As far as I can tell, it isn't able to draw the same character in different situations. Every image is unique and there is so far no way to coax it into drawing a series of multiple images that are consistent with each other, as you would need to illustrate a short story for example. Best example I have seen so far is this, but even that remains very abstract:
https://www.youtube.com/watch?v=J_laffNOoQw https://www.youtube.com/watch?v=J_laffNOoQw
- amelius 4y agoIn Dall-E you can say "... in the style of Van Gogh". So I suppose you could say "... in the style of the previous image" to get consistent results.
- grumbel 4y agoDall-E, like most AI stuff, doesn't have a memory, so you can't just refer to an earlier image. Each time you run it, it starts from scratch. You might be able to (ab)use in-painting for this, i.e. have a comic panel with two image, fill the left side with an existing image, while letting Dall-E finish the right side. Though so far I haven't seen anybody pull that off successfully. In general Dall-E seems to struggle with complex scenes that have multiple characters. For example here is Dall-E trying to create variations of SuperMarioBros box art: https://old.reddit.com/r/dalle2/comments/umrkef/variations_of_input_image_2/ https://old.reddit.com/r/dalle2/comments/umrkef/variations_o... While it goes in the right direction, it's all just a jumbled mess and far less impressive than when Dall-E focuses on a single character, e.g: https://old.reddit.com/r/dalle2/comments/u5vajy/super_mario_as_don_corleone_as_a_still_from_the/ https://old.reddit.com/r/dalle2/comments/u5vajy/super_mario_... https://old.reddit.com/r/dalle2/comments/ubr2xd/a_real_life_photography_of_super_mario_8k_ultra_hd/ https://old.reddit.com/r/dalle2/comments/ubr2xd/a_real_life_... https://old.reddit.com/r/dalle2/comments/ufzk2f/incredible_digital_art_of_sonic_the_hedgehog/ https://old.reddit.com/r/dalle2/comments/ufzk2f/incredible_d...