3 ms·

I would caution that artwork is only 'solved' with relatively simple text prompts. To create a novel painting with a precise mix of elements that would take a p

I would caution that artwork is only 'solved' with relatively simple text prompts. To create a novel painting with a precise mix of elements that would take a paragraph or more to explain is still tough, though DALL-E 2 does seem like a big step towards that.

nahuel0x 5y ago
Also note you can make an image out of many spatially localized prompts combined, in an iterative IA-human process.
sillysaurusx 5y ago
Sam seems to be demoing something fairly close on twitter. https://twitter.com/sama/status/1511724264629678084 https://twitter.com/sama/status/1511724264629678084 The solar powered ship with a propeller sailing under the golden gate bridge during sunset with dolphins jumping around was pretty impressive. https://twitter.com/sama/status/1511731259319349251 https://twitter.com/sama/status/1511731259319349251 I think it's only missing the dolphins.
- drusepth 5y ago
  It should be noted that most "AI-generated" images shared (Sam's included here) are typically just a first pass, whereas most recent models also include some kind of inpainting method, where you can then mask off various parts of an image and continue to edit those specific areas until the whole image is what you're looking for. This process makes it feel a lot more like a "tool" used by artists than a simple magic box that just gives you an "art piece" and you're done. As a tool, this could be used by an artist to continue working on that image until it's exactly what the artist (or the comissioner) is looking for: masking off the water to actually add dolphins, masking off the ship to redraw it, retoning the sky for a more aesthetically-pleasing sunset, adding other objects to specific locations in the scene, etc. Here's one example of how these composite prompts + masking can make more specific images here: https://twitter.com/jmhessel/status/1511757848442654721 https://twitter.com/jmhessel/status/1511757848442654721
  - astrange 5y ago
    I'm not sure how the embeddings ("descriptions") work in DALL-E yet, but in a lot of models they're fixed-length. So there's a natural limit on how many concepts you mention in the first pass before it'll just start leaving them out.
    - deleted 5y ago
      [deleted]

nahuel0x 5y ago

Also note you can make an image out of many spatially localized prompts combined, in an iterative IA-human process.

sillysaurusx 5y ago

Sam seems to be demoing something fairly close on twitter. https://twitter.com/sama/status/1511724264629678084 https://twitter.com/sama/status/1511724264629678084 The solar powered ship with a propeller sailing under the golden gate bridge during sunset with dolphins jumping around was pretty impressive. https://twitter.com/sama/status/1511731259319349251 https://twitter.com/sama/status/1511731259319349251 I think it's only missing the dolphins.

drusepth 5y ago
It should be noted that most "AI-generated" images shared (Sam's included here) are typically just a first pass, whereas most recent models also include some kind of inpainting method, where you can then mask off various parts of an image and continue to edit those specific areas until the whole image is what you're looking for. This process makes it feel a lot more like a "tool" used by artists than a simple magic box that just gives you an "art piece" and you're done. As a tool, this could be used by an artist to continue working on that image until it's exactly what the artist (or the comissioner) is looking for: masking off the water to actually add dolphins, masking off the ship to redraw it, retoning the sky for a more aesthetically-pleasing sunset, adding other objects to specific locations in the scene, etc. Here's one example of how these composite prompts + masking can make more specific images here: https://twitter.com/jmhessel/status/1511757848442654721 https://twitter.com/jmhessel/status/1511757848442654721
- astrange 5y ago
  I'm not sure how the embeddings ("descriptions") work in DALL-E yet, but in a lot of models they're fixed-length. So there's a natural limit on how many concepts you mention in the first pass before it'll just start leaving them out.
  - deleted 5y ago
    [deleted]