5 ms·

Amazing how quickly Dalle-2 went from among the best image transformers to among the worst.

by cainxinth 3y ago

hathym 3y ago
chatgpt next...
- denverllc 3y ago
  Why innovate when you can regulate?
  - flangola7 3y ago
    https://time.com/6288245/openai-eu-lobbying-ai-act/ https://time.com/6288245/openai-eu-lobbying-ai-act/
- ralusek 3y ago
  Dall-E 2 was almost immediately displaced by MidJourney. Nothing comes close to even GPT 3.5 at the moment.
  - sebzim4500 3y ago
    Anthropic's models are better than GPT 3.5 in my opinion.
gwern 3y ago
The stagnation has been very curious. They are part of a large & generally competent org, which otherwise has remained far ahead of the competition, like GPT-4. Except... for DALL-E 2, where it did not just stagnate for over a year (on top of its bizarre blindspots like garbage anime generation), but actually seemed to get worse. They have an experimental model of some sort that some people have access to, but even there, it's nothing to write home about compared to the best models like Parti or eDiff-I etc.
- famouswaffles 3y ago
  Nobody is able to use Parti or eDiff. Compared to models you can use, the experimental Dall-e or Bing Image Creator is second only to midjourney in my experience.
  - Sharlin 3y ago
    I haven't tried those two, but I'd be surprised if they were better than Stable Diffusion. Which is free, runnable (and trainable!) locally, and already has a large ecosystem of frontends, tweaks and customized models.
    - famouswaffles 3y ago
      Believe me, i know all about SD's possible customization and tweaks. I would still easily put both ahead of the base models. You won't match the quality of those models without finetuning. When you do fine-tune, it'll be for a particular aesthetic and you won't match them in terms of prompt understanding and adherence.
  - gwern 3y ago
    Parti/eDiff show that it is relatively easy to do much better than the experimental model which presumably represents their best effort, never mind the hot garbage you see in OP from DALL-E 2. And it's not a calculated degree of low-quality enabled by those models being unreleased and having no competition, because competition like Stable Diffusion or Midjourney are beating the heck out of DALL-E 2 in popular usage.
- sebzim4500 3y ago
  I think they just don't care very much about DALL-E. Which is fair enough, when you are a (relatively) small company competing with the likes of Google and Meta you really need to focus.
- TeMPOraL 3y ago
  I suspect that they consider txt2img to be more of a curiosity now. Sure, it's transformative; it's going to upend whole markets (and make some people a lot of money in the process) - however, it's just producing images. Contrast with LLMs, which have already proven to be generally applicable in great many domains, and that if you squint, are probably capturing the basic mechanisms of thinking. OpenAI lost the lead in txt2img, but GPT-4 is still way ahead of every other LLM. It makes sense for them to focus pretty much 100% on that.
Applejinx 3y ago
I don't know, what I saw in there (particularly with the haunted house) was a far broader POTENTIAL RANGE of outputs. I get that they were cheesier outputs, but it seems to me that those outputs were just as capable of coming from the other 'AIs'… if you let them. It's like each of these has a hidden giant pile of negative prompts, or additional positive prompts, that greatly narrow down the range of output. There are contexts where the Dall-E 'spoopy haunted house ooooo!' imagery would be exactly right… like 'show me halloweeny stock art'. That haunted house prompt didn't explicitly SAY 'oh, also make it look like it's a photo out of a movie and make it look fantastic'. But something in the more 'competitive' AIs knew to go for that. So if you wanted to go for the spoopy cheesey 'collective unconscious' imagery, would you have to force the more sophisticated AIs to go against their hidden requirements? Mind you if you added 'halloween postcard from out of a cheesey old store' and suddenly the other ones were doing that vibe six times better, I'd immediately concede they were in fact that much smarter. I've seen that before, too, in different Stable Diffusion models. I'm just saying that the consistency of output in the 'smarter' ones can also represent a thumb on the scale. They've got to compete by looking sophisticated, so the 'Greg Rutkowskification' effect will kick in: you show off by picking a flashy style to depict rather than going for something equally valid, but less commercial.
- jsnell 3y ago
  It's not just about the haunted house. Just look at the DALLE-2 living room pictures closely. None of it makes any sense. And we're not even talking of subtle details, all of the first three pictures have a central object that the eye should be drawn to that's just a total mess. (The table that's being subsumed by a bunch of melting brown chairs in the first one, the i-don't-even-know-what that seems to be the second picture, and the whatever-this-is on the blue carpet.)
famouswaffles 3y ago
Dall-e experimental is very good (Bing Image creator). I only prefer midjourney to it.
capybara_2020 3y ago
It might be a case of them seeing way more potential with LLMs compared to image generation.
- whywhywhywhy 3y ago
  It’s more that their moat got obliterated on image gen. If stable diffusion didn’t launch Dall-e 2 would have been still valuable.
mrtksn 3y ago
OpenAI screwed up that one by trying to control it. StableDiffusion on the other hand, gives me hope that AI can be high quality and open(not only in name). Can't wait to have something like StableDiffusion but for LLMs.

Amazing how quickly Dalle-2 went from among the best image transformers to among the worst.

hathym 3y ago

chatgpt next...

denverllc 3y ago
Why innovate when you can regulate?
- flangola7 3y ago
  https://time.com/6288245/openai-eu-lobbying-ai-act/ https://time.com/6288245/openai-eu-lobbying-ai-act/
ralusek 3y ago
Dall-E 2 was almost immediately displaced by MidJourney. Nothing comes close to even GPT 3.5 at the moment.
- sebzim4500 3y ago
  Anthropic's models are better than GPT 3.5 in my opinion.

gwern 3y ago

The stagnation has been very curious. They are part of a large & generally competent org, which otherwise has remained far ahead of the competition, like GPT-4. Except... for DALL-E 2, where it did not just stagnate for over a year (on top of its bizarre blindspots like garbage anime generation), but actually seemed to get worse. They have an experimental model of some sort that some people have access to, but even there, it's nothing to write home about compared to the best models like Parti or eDiff-I etc.

famouswaffles 3y ago
Nobody is able to use Parti or eDiff. Compared to models you can use, the experimental Dall-e or Bing Image Creator is second only to midjourney in my experience.
- Sharlin 3y ago
  I haven't tried those two, but I'd be surprised if they were better than Stable Diffusion. Which is free, runnable (and trainable!) locally, and already has a large ecosystem of frontends, tweaks and customized models.
  - famouswaffles 3y ago
    Believe me, i know all about SD's possible customization and tweaks. I would still easily put both ahead of the base models. You won't match the quality of those models without finetuning. When you do fine-tune, it'll be for a particular aesthetic and you won't match them in terms of prompt understanding and adherence.
- gwern 3y ago
  Parti/eDiff show that it is relatively easy to do much better than the experimental model which presumably represents their best effort, never mind the hot garbage you see in OP from DALL-E 2. And it's not a calculated degree of low-quality enabled by those models being unreleased and having no competition, because competition like Stable Diffusion or Midjourney are beating the heck out of DALL-E 2 in popular usage.
sebzim4500 3y ago
I think they just don't care very much about DALL-E. Which is fair enough, when you are a (relatively) small company competing with the likes of Google and Meta you really need to focus.
TeMPOraL 3y ago
I suspect that they consider txt2img to be more of a curiosity now. Sure, it's transformative; it's going to upend whole markets (and make some people a lot of money in the process) - however, it's just producing images. Contrast with LLMs, which have already proven to be generally applicable in great many domains, and that if you squint, are probably capturing the basic mechanisms of thinking. OpenAI lost the lead in txt2img, but GPT-4 is still way ahead of every other LLM. It makes sense for them to focus pretty much 100% on that.

Applejinx 3y ago

I don't know, what I saw in there (particularly with the haunted house) was a far broader POTENTIAL RANGE of outputs. I get that they were cheesier outputs, but it seems to me that those outputs were just as capable of coming from the other 'AIs'… if you let them. It's like each of these has a hidden giant pile of negative prompts, or additional positive prompts, that greatly narrow down the range of output. There are contexts where the Dall-E 'spoopy haunted house ooooo!' imagery would be exactly right… like 'show me halloweeny stock art'. That haunted house prompt didn't explicitly SAY 'oh, also make it look like it's a photo out of a movie and make it look fantastic'. But something in the more 'competitive' AIs knew to go for that. So if you wanted to go for the spoopy cheesey 'collective unconscious' imagery, would you have to force the more sophisticated AIs to go against their hidden requirements? Mind you if you added 'halloween postcard from out of a cheesey old store' and suddenly the other ones were doing that vibe six times better, I'd immediately concede they were in fact that much smarter. I've seen that before, too, in different Stable Diffusion models. I'm just saying that the consistency of output in the 'smarter' ones can also represent a thumb on the scale. They've got to compete by looking sophisticated, so the 'Greg Rutkowskification' effect will kick in: you show off by picking a flashy style to depict rather than going for something equally valid, but less commercial.

jsnell 3y ago
It's not just about the haunted house. Just look at the DALLE-2 living room pictures closely. None of it makes any sense. And we're not even talking of subtle details, all of the first three pictures have a central object that the eye should be drawn to that's just a total mess. (The table that's being subsumed by a bunch of melting brown chairs in the first one, the i-don't-even-know-what that seems to be the second picture, and the whatever-this-is on the blue carpet.)

famouswaffles 3y ago

Dall-e experimental is very good (Bing Image creator). I only prefer midjourney to it.

capybara_2020 3y ago

It might be a case of them seeing way more potential with LLMs compared to image generation.

whywhywhywhy 3y ago
It’s more that their moat got obliterated on image gen. If stable diffusion didn’t launch Dall-e 2 would have been still valuable.

mrtksn 3y ago

OpenAI screwed up that one by trying to control it. StableDiffusion on the other hand, gives me hope that AI can be high quality and open(not only in name). Can't wait to have something like StableDiffusion but for LLMs.