3 ms·

Here's a custom prompt that I enjoyed: "Think hard about every single detail of the image, conceptualize it including the style, colors, and lighting. Final s

Here's a custom prompt that I enjoyed: "Think hard about every single detail of the image, conceptualize it including the style, colors, and lighting. Final step, condensing this into a single paragraph: Very carefully, condense your thoughts using the most prominent features and extremely precise language into a single paragraph." https://dalle.party/?party=1lSMniUP https://dalle.party/?party=1lSMniUP https://dalle.party/?party=cEUyjzch https://dalle.party/?party=cEUyjzch https://dalle.party/?party=14fnkTv- https://dalle.party/?party=14fnkTv- https://dalle.party/?party=wstiY-Iw https://dalle.party/?party=wstiY-Iw Praise the Basilisk, I finally got rate-limited and can go to bed!

Blammar 3y ago
The thing that is truly mindboggling to me is that THE SHADOWS IN THE IMAGES ARE CORRECT. How is that possible??? Does DALL-E actually have a shadow-tracing component?
- jiggawatts 3y ago
  Yes! It can also get reflections and refractions mostly correct.
- Rastonbury 3y ago
  Stable diffusion does decent reflections too
- l33tman 3y ago
  Research into the internals of the networks have shown that they figure out the correct 2.5D representation of the scene before the RGB textures (internally), so yes it seems they have an internal representation of the scene and therefore can do enough inference from that to make shadows and light seem natural. I guess it's not that far-fetched as your brain has to do the same to figure out if a scene (or an AI-generated one for that matter) has some weird issue that should pop out. So in a sense your brain does this too.
  - Chirono 3y ago
    Interesting! Do you have a link to that research?
    - l33tman 3y ago
      Certainly: https://arxiv.org/abs/2306.05720 https://arxiv.org/abs/2306.05720 It's a very interesting paper. "Even when trained purely on images without explicit depth information, they typically output coherent pictures of 3D scenes. In this work, we investigate a basic interpretability question: does an LDM create and use an internal representation of simple scene geometry? Using linear probes, we find evidence that the internal activations of the LDM encode linear representations of both 3D depth data and a salient-object / background distinction. These representations appear surprisingly early in the denoising process−well before a human can easily make sense of the noisy images."
  - nojvek 3y ago
    What does 2.5D mean?
    - shsbdncudx 3y ago
      It means you should be worried about the guy she told you not to worry about
    - l33tman 3y ago
      You usually say 2.5D when it's a 3D but only from a single vantage point with no info of the back-facing side of objects. Like the representation you get from a depth-sensor on a mobile phone, or when trying to extract depth from a single photo.
- throwaway290 3y ago
  I randomly checked a few links here and shadows were correct in 2 images out of a dozen... and any people tend to be horrifying in many
re 3y ago
> https://dalle.party/?party=14fnkTv- https://dalle.party/?party=14fnkTv- Interesting that for one and only one iteration, the anthropomorphized cardboard boxes it draws are almost all Danbo: https://duckduckgo.com/?q=danbo+character&ia=images&iax=images https://duckduckgo.com/?q=danbo+character&ia=images&iax=imag... It was surprising to see a recognizable character in the middle of a bunch of more fantastical images.
- bee_rider 3y ago
  Short focal length was a neat idea, it let it left lots of room for the subsequent iterations to fill in the background.
epiccoleman 3y ago
The fractal one is awesome!
SushiHippie 3y ago
Mine got surral real fast, though the sixth one is kinda cool https://dalle.party/?party=DNgriW_E https://dalle.party/?party=DNgriW_E
- nathanfig 3y ago
  These are fantastic
ArekDymalski 3y ago
> https://dalle.party/?party=1lSMniUP https://dalle.party/?party=1lSMniUP It's very interesting to observe how the relationship between the wolf and Redhood evolved from dark and menacing to serene and friendly.

Blammar 3y ago

The thing that is truly mindboggling to me is that THE SHADOWS IN THE IMAGES ARE CORRECT. How is that possible??? Does DALL-E actually have a shadow-tracing component?

jiggawatts 3y ago
Yes! It can also get reflections and refractions mostly correct.
Rastonbury 3y ago
Stable diffusion does decent reflections too
l33tman 3y ago
Research into the internals of the networks have shown that they figure out the correct 2.5D representation of the scene before the RGB textures (internally), so yes it seems they have an internal representation of the scene and therefore can do enough inference from that to make shadows and light seem natural. I guess it's not that far-fetched as your brain has to do the same to figure out if a scene (or an AI-generated one for that matter) has some weird issue that should pop out. So in a sense your brain does this too.
- Chirono 3y ago
  Interesting! Do you have a link to that research?
  - l33tman 3y ago
    Certainly: https://arxiv.org/abs/2306.05720 https://arxiv.org/abs/2306.05720 It's a very interesting paper. "Even when trained purely on images without explicit depth information, they typically output coherent pictures of 3D scenes. In this work, we investigate a basic interpretability question: does an LDM create and use an internal representation of simple scene geometry? Using linear probes, we find evidence that the internal activations of the LDM encode linear representations of both 3D depth data and a salient-object / background distinction. These representations appear surprisingly early in the denoising process−well before a human can easily make sense of the noisy images."
- nojvek 3y ago
  What does 2.5D mean?
  - shsbdncudx 3y ago
    It means you should be worried about the guy she told you not to worry about
  - l33tman 3y ago
    You usually say 2.5D when it's a 3D but only from a single vantage point with no info of the back-facing side of objects. Like the representation you get from a depth-sensor on a mobile phone, or when trying to extract depth from a single photo.
throwaway290 3y ago
I randomly checked a few links here and shadows were correct in 2 images out of a dozen... and any people tend to be horrifying in many

re 3y ago

> https://dalle.party/?party=14fnkTv- https://dalle.party/?party=14fnkTv- Interesting that for one and only one iteration, the anthropomorphized cardboard boxes it draws are almost all Danbo: https://duckduckgo.com/?q=danbo+character&ia=images&iax=images https://duckduckgo.com/?q=danbo+character&ia=images&iax=imag... It was surprising to see a recognizable character in the middle of a bunch of more fantastical images.

bee_rider 3y ago
Short focal length was a neat idea, it let it left lots of room for the subsequent iterations to fill in the background.

epiccoleman 3y ago

The fractal one is awesome!

SushiHippie 3y ago

Mine got surral real fast, though the sixth one is kinda cool https://dalle.party/?party=DNgriW_E https://dalle.party/?party=DNgriW_E

nathanfig 3y ago
These are fantastic

ArekDymalski 3y ago

> https://dalle.party/?party=1lSMniUP https://dalle.party/?party=1lSMniUP It's very interesting to observe how the relationship between the wolf and Redhood evolved from dark and menacing to serene and friendly.