5 ms·

If anyone's interested: last year I generated around 7,000 images using DALL•E 2 and uploaded them to https://generrated.com/ https://generrated.com/ I wanted

If anyone's interested: last year I generated around 7,000 images using DALL•E 2 and uploaded them to https://generrated.com/ https://generrated.com/ I wanted a way to experiment/see what DALL•E 2 could create and share with others as some sort of inspiration/a starting point. This was before the API was available, so I had to generate and save them all manually. And it was rather expensive! But fun. Looks like I'll have to update them all for DALL•E 3 when I get access.

dinkleberg 3y ago
If you end up doing that, it would be cool to see the comparison of the v2 vs v3 images.
- davidbarker 3y ago
  Absolutely. I've already started thinking about how I could incorporate some kind of comparison feature. Because there's no way to control the seed, a direct comparison (using a before/after slider, for example) probably wouldn't make sense. But I could put the group of 4 images from each version above/below each other as a general comparison, perhaps?
  - thewataccount 3y ago
    > Because there's no way to control the seed, a direct comparison (using a before/after slider, for example) probably wouldn't make sense. Even if it was the same seed, from my understanding Dalle3 would have to be just a further trained version of the same checkpoint to even resemble Dalle2's image. Like stable diffusion 1.4 vs 1.5 and 2.0 and 2.1 will make identifiably similar images, but 1.5 vs 2.1 vs SDXL won't look remotely similar. Even more so because I'd wager they changed their encoder and/or decoder too. * I think that if they generated something like a controlnet for guidance the same way in both models then they might be comparable but from my understanding Dalle2 doesn't work that way at all. Comparisons would still be interesting though!
    - davidbarker 3y ago
      I think you're right — I thought about it a little more after I replied. I guess it'll just have to be comparisons of the general concepts. It'll be good to see the change in understanding of the prompt and the change in image detail. If anyone at OpenAI wants to give me early access to give me a head-start… smiles
      - thewataccount 3y ago
        Yeah I'll be interested to see how much you have to change the prompts to get similar styles
  - deleted 3y ago
    [deleted]
tempaccount420 3y ago
You can't use artist names in prompts anymore so I don't think you'll be able to use DALL-E 3 there? EDIT: it's only living artists actually that you can't prompt (hopefully, the article says so at least)
- davidbarker 3y ago
  I think it'll decline if you ask for a living artist, but sounds like it'll work for other artists. But otherwise you're right — some might not work.
  - delano 3y ago
    Crafting descriptions of an artist and/or individual works may function as a reasonable replacement for specific names. That's what's happening behind the scenes anyway. It's an interesting problem. Like, what's the point of conception for a work of art?
- lcnPylGDnU4H9OF 3y ago
  That's kind of an interesting way to handle the copyright issues. Not sure how effective it is as I suspect that can be bypassed by including a bunch of details about the artist but not the name. > ... in the style of a famous Spanish artist who was born in 1881 and passed away in 1973 [and a bunch of other shit about Pablo Picasso] (I also notice that this is more verbose than just "in the style of Pablo Picasso", which probably helps OpenAI's bottom line given costs associated with token counts. I doubt that's their intention with the change, just something of note. And, of course, a living example would be more applicable for copyright issues but the idea is still demonstrated.)
  - andromaton 3y ago
    The artist whose name includes Diego José Francisco de Paula Juan Nepomuceno María de los Remedios Cipriano de la Santísima Trinidad Ruiz.
somenameforme 3y ago
Is anybody aware of the specific technical reason that it struggles with words so much? There seems to be enough of a pattern to create a million reasonable hypotheses - curiosity makes me want to which it really is! Looking at the images it's particularly interesting how it seems to have never once gotten the text correct, always just being a little bit off. Well sometimes way off, but mostly quite close.
- gwern 3y ago
  Points to them still relying on a single small text embedding which is lossy instead of full cross-attention; but the fact that it can follow instructions reasonably well at least means that they've moved off CLIP - phew! It was frustrating arguing with people about DALL-E 2 limitations which were ultimately due to nothing but CLIP.
epivosism 3y ago
Yeah, it's really strange how hard they make it to manage, download, and get full prompts for your images on all these platforms. I made this discord bot for midjourney which with some easy configuration can download and annotate all your images, including as much info as I could grab about version, etc. https://github.com/ernop/social-ai/tree/main/SocialAI https://github.com/ernop/social-ai/tree/main/SocialAI Even then it's not perfect since I'm getting info off of the command you send, which may have fallen into whatever the defaults were at the time, and so when interpreted today, not easily possible to reconstruct the version/seed/etc. from that point in the past, if you didn't include it in the prompt. But still, I just like having a folder of 30k images that I can never lose, with at least the prompt, so I can go through and re-run them later (even manually) to get comparisons over time.
tomcam 3y ago
Yes, I'm interested! It's absolutely incredible to have your pictures with the associated prompts. Thanks a ton!
- davidbarker 3y ago
  Very kind of you to say — thanks!
stolsvik 3y ago
That was really good. At first I thought it was a bit dull with just those 5 images, but the tons of different styles and concepts exemplified made it a great inspiration.

dinkleberg 3y ago

If you end up doing that, it would be cool to see the comparison of the v2 vs v3 images.

davidbarker 3y ago
Absolutely. I've already started thinking about how I could incorporate some kind of comparison feature. Because there's no way to control the seed, a direct comparison (using a before/after slider, for example) probably wouldn't make sense. But I could put the group of 4 images from each version above/below each other as a general comparison, perhaps?
- thewataccount 3y ago
  > Because there's no way to control the seed, a direct comparison (using a before/after slider, for example) probably wouldn't make sense. Even if it was the same seed, from my understanding Dalle3 would have to be just a further trained version of the same checkpoint to even resemble Dalle2's image. Like stable diffusion 1.4 vs 1.5 and 2.0 and 2.1 will make identifiably similar images, but 1.5 vs 2.1 vs SDXL won't look remotely similar. Even more so because I'd wager they changed their encoder and/or decoder too. * I think that if they generated something like a controlnet for guidance the same way in both models then they might be comparable but from my understanding Dalle2 doesn't work that way at all. Comparisons would still be interesting though!
  - davidbarker 3y ago
    I think you're right — I thought about it a little more after I replied. I guess it'll just have to be comparisons of the general concepts. It'll be good to see the change in understanding of the prompt and the change in image detail. If anyone at OpenAI wants to give me early access to give me a head-start… smiles
    - thewataccount 3y ago
      Yeah I'll be interested to see how much you have to change the prompts to get similar styles
- deleted 3y ago
  [deleted]

tempaccount420 3y ago

You can't use artist names in prompts anymore so I don't think you'll be able to use DALL-E 3 there? EDIT: it's only living artists actually that you can't prompt (hopefully, the article says so at least)

davidbarker 3y ago
I think it'll decline if you ask for a living artist, but sounds like it'll work for other artists. But otherwise you're right — some might not work.
- delano 3y ago
  Crafting descriptions of an artist and/or individual works may function as a reasonable replacement for specific names. That's what's happening behind the scenes anyway. It's an interesting problem. Like, what's the point of conception for a work of art?
lcnPylGDnU4H9OF 3y ago
That's kind of an interesting way to handle the copyright issues. Not sure how effective it is as I suspect that can be bypassed by including a bunch of details about the artist but not the name. > ... in the style of a famous Spanish artist who was born in 1881 and passed away in 1973 [and a bunch of other shit about Pablo Picasso] (I also notice that this is more verbose than just "in the style of Pablo Picasso", which probably helps OpenAI's bottom line given costs associated with token counts. I doubt that's their intention with the change, just something of note. And, of course, a living example would be more applicable for copyright issues but the idea is still demonstrated.)
- andromaton 3y ago
  The artist whose name includes Diego José Francisco de Paula Juan Nepomuceno María de los Remedios Cipriano de la Santísima Trinidad Ruiz.

somenameforme 3y ago

Is anybody aware of the specific technical reason that it struggles with words so much? There seems to be enough of a pattern to create a million reasonable hypotheses - curiosity makes me want to which it really is! Looking at the images it's particularly interesting how it seems to have never once gotten the text correct, always just being a little bit off. Well sometimes way off, but mostly quite close.

gwern 3y ago
Points to them still relying on a single small text embedding which is lossy instead of full cross-attention; but the fact that it can follow instructions reasonably well at least means that they've moved off CLIP - phew! It was frustrating arguing with people about DALL-E 2 limitations which were ultimately due to nothing but CLIP.

epivosism 3y ago

Yeah, it's really strange how hard they make it to manage, download, and get full prompts for your images on all these platforms. I made this discord bot for midjourney which with some easy configuration can download and annotate all your images, including as much info as I could grab about version, etc. https://github.com/ernop/social-ai/tree/main/SocialAI https://github.com/ernop/social-ai/tree/main/SocialAI Even then it's not perfect since I'm getting info off of the command you send, which may have fallen into whatever the defaults were at the time, and so when interpreted today, not easily possible to reconstruct the version/seed/etc. from that point in the past, if you didn't include it in the prompt. But still, I just like having a folder of 30k images that I can never lose, with at least the prompt, so I can go through and re-run them later (even manually) to get comparisons over time.

tomcam 3y ago

Yes, I'm interested! It's absolutely incredible to have your pictures with the associated prompts. Thanks a ton!

davidbarker 3y ago
Very kind of you to say — thanks!

stolsvik 3y ago

That was really good. At first I thought it was a bit dull with just those 5 images, but the tons of different styles and concepts exemplified made it a great inspiration.