5 ms·

Equal or better quality? I suppose it depends on what you are trying to create, but that hasn't been my experience at all.

johnfn 4y ago
Which one are you comparing against? I've tried hundreds of prompts between SD and DALL-E and get comparable results. Midjourney was lagging for a while, but the new --testp parameter is really remarkable, which, in my view, makes it superior not only to Stable Diffusion but also to DALL-E as well.
- yreg 4y ago
  My experience is that with prompts that fit into OpenAI's limiting content policy DALL-E text2img results are usually much better. And I use SD like 95% of the time, so it's not the case that I would be more used to DALL-E.
  - KaoruAoiShiho 4y ago
    I need some examples because I don't really see it for the vast majority of usecases.
    - yreg 4y ago
      Here I wanted to illustrate the game Waffle[0], first attempt with Dalle was pretty good, not true for SD: https://labs.openai.com/s/rCzJwauuiaIj1Pd3IyJGaHS3 https://labs.openai.com/s/rCzJwauuiaIj1Pd3IyJGaHS3 Here I wanted an illustration of a nuclear plant in a japanese landscape, first attempt with Dalle produced multiple good results. I tried SD and MJ (back when MJ didn't use SD) as well, had trouble even with multiple attempts: https://labs.openai.com/s/FxhxtMFe3kFS8msV8vekRAJ3 https://labs.openai.com/s/FxhxtMFe3kFS8msV8vekRAJ3 There are others, but anyway I think my examples are not important since it will be always easy to cherry pick prompts that yield the best results in model X. In my experience SD is good at producing (especially non-photo-realistic) art that looks pretty and DALL-E is better at following a specific prompt when I know what exactly I want. Of course I recognise your experience might (and probably does) differ. [0] - https://wafflegame.net/ https://wafflegame.net/
- gpt5 4y ago
  An easy example of DALL-E superiority is its ability to combine two different concepts together. For example, DALL-E performs extremely impressively on prompts in the format of “a still of homer Simpson in The Godfather” (replace character and movie as you wish). with the other two it’s a lot of misses
  - TillE 4y ago
    Yeah you're right that Stable Diffusion produces garbage for that prompt. I'd love to see a site with lots of examples of the same prompt fed into various models, I assume someone has already made that.
    - zimpenfish 4y ago
      > Yeah you're right that Stable Diffusion produces garbage for that prompt. I dunno, I generated 20 images from that prompt locally and got three good ones[1]. https://imgur.com/a/rZ6wOEF https://imgur.com/a/rZ6wOEF
      - wunderbaba 4y ago
        What? None of the people in these images are even remotely recognizable as Homer Simpson.
        zimpenfish 4y ago
        What would you count as a pass then? A literal rendering of the cartoon Homer Simpson on top of a still from the actual Godfather film?
        gpt5 4y ago
        Check out DALL-E results for similar prompts: https://twitter.com/Dalle2Pics/status/1534718848137560064?ref_src=twsrc%5Etfw https://twitter.com/Dalle2Pics/status/1534718848137560064?re...
hooloovoo_zoo 4y ago
Agreed; SD barely follows prompts at all.
- zimpenfish 4y ago
  > Agreed; SD barely follows prompts at all. I would heartily disagree - I've generated ~6.5k images using SD locally and most of them could be linked to the prompt they came from.
  - hooloovoo_zoo 4y ago
    Doesn’t ‘most of them could be linked to the prompt they came from’ strike you as damning with faint praise?
    - twojacobtwo 4y ago
      > SD barely follows prompts at all. > ...and most of them could be linked to the prompt they came from. You made it sound as if there is almost no connection between the prompt and the images and zimpenfish said that the majority could be linked, implying a strong connection. He/she doesn't have to be praising it at all to counter your claim.
    - zimpenfish 4y ago
      Not hugely - e.g. taking the 38 prompts including "a painting by William Adolphe Bouguereau" (which is easily the worst of the modifiers for me), 10 of them I'd say were "no clue to the prompt". For the 56 Munch images, 54 were good and 2 were quibbles ("an isopod as an angel" had no isopod but did have an angelic human - is that a pass or no?) (Which is probably better than you'd get from a human given the exact same prompts.)
  - itintheory 4y ago
    Have you seen a decent tutorial for setting up SD locally? I've been using it through huggingface, but that seems pretty limited.

johnfn 4y ago

Which one are you comparing against? I've tried hundreds of prompts between SD and DALL-E and get comparable results. Midjourney was lagging for a while, but the new --testp parameter is really remarkable, which, in my view, makes it superior not only to Stable Diffusion but also to DALL-E as well.

yreg 4y ago
My experience is that with prompts that fit into OpenAI's limiting content policy DALL-E text2img results are usually much better. And I use SD like 95% of the time, so it's not the case that I would be more used to DALL-E.
- KaoruAoiShiho 4y ago
  I need some examples because I don't really see it for the vast majority of usecases.
  - yreg 4y ago
    Here I wanted to illustrate the game Waffle[0], first attempt with Dalle was pretty good, not true for SD: https://labs.openai.com/s/rCzJwauuiaIj1Pd3IyJGaHS3 https://labs.openai.com/s/rCzJwauuiaIj1Pd3IyJGaHS3 Here I wanted an illustration of a nuclear plant in a japanese landscape, first attempt with Dalle produced multiple good results. I tried SD and MJ (back when MJ didn't use SD) as well, had trouble even with multiple attempts: https://labs.openai.com/s/FxhxtMFe3kFS8msV8vekRAJ3 https://labs.openai.com/s/FxhxtMFe3kFS8msV8vekRAJ3 There are others, but anyway I think my examples are not important since it will be always easy to cherry pick prompts that yield the best results in model X. In my experience SD is good at producing (especially non-photo-realistic) art that looks pretty and DALL-E is better at following a specific prompt when I know what exactly I want. Of course I recognise your experience might (and probably does) differ. [0] - https://wafflegame.net/ https://wafflegame.net/
gpt5 4y ago
An easy example of DALL-E superiority is its ability to combine two different concepts together. For example, DALL-E performs extremely impressively on prompts in the format of “a still of homer Simpson in The Godfather” (replace character and movie as you wish). with the other two it’s a lot of misses
- TillE 4y ago
  Yeah you're right that Stable Diffusion produces garbage for that prompt. I'd love to see a site with lots of examples of the same prompt fed into various models, I assume someone has already made that.
  - zimpenfish 4y ago
    > Yeah you're right that Stable Diffusion produces garbage for that prompt. I dunno, I generated 20 images from that prompt locally and got three good ones[1]. https://imgur.com/a/rZ6wOEF https://imgur.com/a/rZ6wOEF
    - wunderbaba 4y ago
      What? None of the people in these images are even remotely recognizable as Homer Simpson.
      - zimpenfish 4y ago
        What would you count as a pass then? A literal rendering of the cartoon Homer Simpson on top of a still from the actual Godfather film?
        gpt5 4y ago
        Check out DALL-E results for similar prompts: https://twitter.com/Dalle2Pics/status/1534718848137560064?ref_src=twsrc%5Etfw https://twitter.com/Dalle2Pics/status/1534718848137560064?re...

hooloovoo_zoo 4y ago

Agreed; SD barely follows prompts at all.

zimpenfish 4y ago
> Agreed; SD barely follows prompts at all. I would heartily disagree - I've generated ~6.5k images using SD locally and most of them could be linked to the prompt they came from.
- hooloovoo_zoo 4y ago
  Doesn’t ‘most of them could be linked to the prompt they came from’ strike you as damning with faint praise?
  - twojacobtwo 4y ago
    > SD barely follows prompts at all. > ...and most of them could be linked to the prompt they came from. You made it sound as if there is almost no connection between the prompt and the images and zimpenfish said that the majority could be linked, implying a strong connection. He/she doesn't have to be praising it at all to counter your claim.
  - zimpenfish 4y ago
    Not hugely - e.g. taking the 38 prompts including "a painting by William Adolphe Bouguereau" (which is easily the worst of the modifiers for me), 10 of them I'd say were "no clue to the prompt". For the 56 Munch images, 54 were good and 2 were quibbles ("an isopod as an angel" had no isopod but did have an angelic human - is that a pass or no?) (Which is probably better than you'd get from a human given the exact same prompts.)
- itintheory 4y ago
  Have you seen a decent tutorial for setting up SD locally? I've been using it through huggingface, but that seems pretty limited.