3 ms·

ChatGPT's prompt adherence is light years ahead of all the others. I won't even call Flux/Midjoueny its competitors. ChatGPT image gen is practically a one-of-i

ChatGPT's prompt adherence is light years ahead of all the others. I won't even call Flux/Midjoueny its competitors. ChatGPT image gen is practically a one-of-its-kind unique product on the market: the only usable AI image editor for people without image editing experience. I think in terms of image generation, ChatGPT is the biggest leap since Stable Diffusion's release. LoRA/ControlNet/Flux are forgettable in comparison.

soared 2y ago
This is a take so incredulous it doesn’t seem credible.
- tacoooooooo 2y ago
  its 100% the correct take
  - fkyoureadthedoc 2y ago
    yeah this is my personal experience. The new image generation is the only reason I keep an OpenAI subscription rather than switching to Google.
- mediaman 2y ago
  It is correct, the shift from diffusion to transformers is a very, very big difference.
- stavros 2y ago
  I can confirm, ChatGPT's prompt adherence is so incredibly good, it gets even really small details right, to a level that diffusion-based generators couldn't even dream of.
- abhpro 2y ago
  Also chiming in to say you're wrong, I mean they're correct
thegeomaster 2y ago
Well, there's also gemini-2.0-flash-exp-image-generation. Also autoregressive/transfusion based.
- thefourthchime 2y ago
  Such a good name....
- yousif_123123 2y ago
  It's also good but clearly not close still. Maybe Gemini 2.5 or 3 will have better image gen.
- Yiling-J 2y ago
  gemini-2.0-flash-exp-image-generation doesn’t perform as well as GPT-4o's image generation, as mentioned in section 5.1 of this paper: https://arxiv.org/pdf/2504.02782 https://arxiv.org/pdf/2504.02782. However based on my test, for certain types of images such as realistic recipe images, the results are quite good. You can see some examples here: https://github.com/Yiling-J/tablepilot/tree/main/examples/100_recipes https://github.com/Yiling-J/tablepilot/tree/main/examples/10...
- swyx 2y ago
  > transfusion based. what is that?
  - thegeomaster 2y ago
    It's a mix between the Transformer architecture and diffusion, shown to provide better output results than simple autoregressive image token generation alone: https://arxiv.org/html/2408.11039v1 https://arxiv.org/html/2408.11039v1 Of course, nobody really knows what 4o image generation really is under the hood, but it looks to be like some kind of hybrid system like Transfusion to me. It is much better at prompt adherence than diffusion models, but its output can be clunkier/stylistically incoherent. At times, it also exhibits similar failure modes as diffusion (such as weirdly rotated body parts). Given how it behaves, I think Gemini 2.0 Flash image generation is probably the same approach but with a smaller parameter count. It's... eerie... how close together these two were released and how similar they appear to be.
echelon 2y ago
I'd go out on a limb and say that even your praise of gpt-image-1 is underselling its true potential. This model is as remarkable as when ChatGPT first entered the market. People are sleeping on its capabilities. It's a replacement for ComfyUI and potentially most of Adobe in time. Now for the bad part: I don't think Black Forest Labs, StabilityAI, MidJourney, or any of the others can compete with this. They probably don't have the money to train something this large and sophisticated. We might be stuck with OpenAI and Google (soon) for providing advanced multimodal image models. Maybe we'll get lucky and one of the large Chinese tech companies will drop a model with this power. But I doubt it. This might be the first OpenAI product with an extreme moat.
- raincole 2y ago
  > Now for the bad part: I don't think Black Forest Labs, StabilityAI, MidJourney, or any of the others can compete with this. Yeah. I'm a tad sad about it. I once thought the SD ecosystem proves open-source won when it comes to image gen (a naive idea, I know). It turns out big corps won hard in this regard.

soared 2y ago

This is a take so incredulous it doesn’t seem credible.

tacoooooooo 2y ago
its 100% the correct take
- fkyoureadthedoc 2y ago
  yeah this is my personal experience. The new image generation is the only reason I keep an OpenAI subscription rather than switching to Google.
mediaman 2y ago
It is correct, the shift from diffusion to transformers is a very, very big difference.
stavros 2y ago
I can confirm, ChatGPT's prompt adherence is so incredibly good, it gets even really small details right, to a level that diffusion-based generators couldn't even dream of.
abhpro 2y ago
Also chiming in to say you're wrong, I mean they're correct

thegeomaster 2y ago

Well, there's also gemini-2.0-flash-exp-image-generation. Also autoregressive/transfusion based.

thefourthchime 2y ago
Such a good name....
yousif_123123 2y ago
It's also good but clearly not close still. Maybe Gemini 2.5 or 3 will have better image gen.
Yiling-J 2y ago
gemini-2.0-flash-exp-image-generation doesn’t perform as well as GPT-4o's image generation, as mentioned in section 5.1 of this paper: https://arxiv.org/pdf/2504.02782 https://arxiv.org/pdf/2504.02782. However based on my test, for certain types of images such as realistic recipe images, the results are quite good. You can see some examples here: https://github.com/Yiling-J/tablepilot/tree/main/examples/100_recipes https://github.com/Yiling-J/tablepilot/tree/main/examples/10...
swyx 2y ago
> transfusion based. what is that?
- thegeomaster 2y ago
  It's a mix between the Transformer architecture and diffusion, shown to provide better output results than simple autoregressive image token generation alone: https://arxiv.org/html/2408.11039v1 https://arxiv.org/html/2408.11039v1 Of course, nobody really knows what 4o image generation really is under the hood, but it looks to be like some kind of hybrid system like Transfusion to me. It is much better at prompt adherence than diffusion models, but its output can be clunkier/stylistically incoherent. At times, it also exhibits similar failure modes as diffusion (such as weirdly rotated body parts). Given how it behaves, I think Gemini 2.0 Flash image generation is probably the same approach but with a smaller parameter count. It's... eerie... how close together these two were released and how similar they appear to be.

echelon 2y ago

I'd go out on a limb and say that even your praise of gpt-image-1 is underselling its true potential. This model is as remarkable as when ChatGPT first entered the market. People are sleeping on its capabilities. It's a replacement for ComfyUI and potentially most of Adobe in time. Now for the bad part: I don't think Black Forest Labs, StabilityAI, MidJourney, or any of the others can compete with this. They probably don't have the money to train something this large and sophisticated. We might be stuck with OpenAI and Google (soon) for providing advanced multimodal image models. Maybe we'll get lucky and one of the large Chinese tech companies will drop a model with this power. But I doubt it. This might be the first OpenAI product with an extreme moat.

raincole 2y ago
> Now for the bad part: I don't think Black Forest Labs, StabilityAI, MidJourney, or any of the others can compete with this. Yeah. I'm a tad sad about it. I once thought the SD ecosystem proves open-source won when it comes to image gen (a naive idea, I know). It turns out big corps won hard in this regard.