3 ms·
I've been playing around with it for the past hour. It's really good but from my preliminary testing it definitely falls short of gpt-image-1 (or even Imagen 3/
by vunderba 1y ago
I've been playing around with it for the past hour. It's really good but from my preliminary testing it definitely falls short of gpt-image-1 (or even Imagen 3/4) where reasonably complex strict prompt adherence is concerned. Scored around ~50% where gpt-image-1 scored ~75%. Couldn't handle the maze, Schrödinger's equation, etc.
https://genai-showdown.specr.net https://genai-showdown.specr.net
- supermatt 1y agoIs it fair to call the OpenAI octopus “real”?
- bavell 1y agoFantastic comparisons! Great to see the limitations of the latest models.
- xarope 1y agointeresting to see how many still can't handle the nine pointed star correctly
- nilsherzig 1y agoGreat work, thanks. Midjourneys images are the only ones which don’t make me uncomfortable (most of the time), hopefully they can fix their prompt adherence.
- jgalt212 1y agoI too have have been underwhelmed by these pelican on a bicycle creators. We used to use them for company blog art, by lately we've switched to using attributed images from Wikimedia commons.
- cubefox 1y agoPrompt idea: "A person holding a wooden Penrose triangle." Only GPT-4o image generation is able to make Penrose triangles, as far as I can tell.
- imcritic 1y agoThanks for that comparison/overview/benchmark! However, you have mistakenly marked some answers as correct ones in the octopus prompt: only 1 generated image has octopus have sock puppets on all of its tentacles. And you marked that one image as an incorrect one due to sock looking more like gloves.