3 ms·

I've updated my GenAI Comparison site to include Imagen4 Ultra, so now we have four Google related generative models (Gemini Flash, Imagen3, Imagen4, and Imagen

I've updated my GenAI Comparison site to include Imagen4 Ultra, so now we have four Google related generative models (Gemini Flash, Imagen3, Imagen4, and Imagen4 Ultra). Despite claims that Ultra supports improved strict prompt adherence, we saw no evidence that it scored any better than Imagen 4 and in some cases seemed to ignore the prompt altogether (see the "Not the Bees" comic). In many cases, it also seemed much less steerable than Imagen3 requiring many of the prompts to be rewritten. https://genai-showdown.specr.net?models=IMAGEN_3,IMAGEN_4,IMAGEN_4_ULTRA https://genai-showdown.specr.net?models=IMAGEN_3,IMAGEN_4,IM...

gizmodo59 1y ago
Looks like OpenAI imagegen is still the SOTA?
- BoorishBears 1y ago
  LMArena (https://lmarena.ai/?chat-modality=image https://lmarena.ai/?chat-modality=image) currently has a model codenamed `nano-banana` that is generally strictly better than gpt-image-1 There's some speculation it's Gemini 3's multi-modal output, and other speculation that it's an OpenAI model. Hard to definitively since these models tend to hallucinate when interrogated.
  - deleted 1y ago
    [deleted]
  - vunderba 1y ago
    Other than LMArena and a website I can't verify is authentic, it's hard for me to run tests on this new model but I have serious doubts that it'll pass my more difficult prompts such drawing a valid 2d maze with clearly marked exit and entrance. gpt-image-1 is in a class all of its own with regards to prompt adherence in the "text to image" category. Once it hits GA I'll put it through its paces and add it to the site!
  - cubefox 1y ago
    I tested it with generating a man holding a Penrose triangle made of wood. While gpt-image-1 succeeded, nano-banana failed. The aesthetics of nano-banana did look much better though. I would guess that it is a diffusion model, based on the fact that it adds irrelevant but pretty background details, which gpt-image-1 tends to avoid.

gizmodo59 1y ago

Looks like OpenAI imagegen is still the SOTA?

BoorishBears 1y ago
LMArena (https://lmarena.ai/?chat-modality=image https://lmarena.ai/?chat-modality=image) currently has a model codenamed `nano-banana` that is generally strictly better than gpt-image-1 There's some speculation it's Gemini 3's multi-modal output, and other speculation that it's an OpenAI model. Hard to definitively since these models tend to hallucinate when interrogated.
- deleted 1y ago
  [deleted]
- vunderba 1y ago
  Other than LMArena and a website I can't verify is authentic, it's hard for me to run tests on this new model but I have serious doubts that it'll pass my more difficult prompts such drawing a valid 2d maze with clearly marked exit and entrance. gpt-image-1 is in a class all of its own with regards to prompt adherence in the "text to image" category. Once it hits GA I'll put it through its paces and add it to the site!
- cubefox 1y ago
  I tested it with generating a man holding a Penrose triangle made of wood. While gpt-image-1 succeeded, nano-banana failed. The aesthetics of nano-banana did look much better though. I would guess that it is a diffusion model, based on the fact that it adds irrelevant but pretty background details, which gpt-image-1 tends to avoid.