4 ms·
I just tried your trademark benchmark on the new 4o Image Output, though it's not the same test: https://imgur.com/a/xuPn8Yq https://imgur.com/a/xuPn8Yq
by kridsdale3 2y ago
I just tried your trademark benchmark on the new 4o Image Output, though it's not the same test:
https://imgur.com/a/xuPn8Yq https://imgur.com/a/xuPn8Yq
- Unroasted6154 2y agoWas that an actual SVG?
- simonw 2y agoNo that's GPT-4o native image output.
- sebzim4500 2y agoI wonder how far away we are from models which, given this prompt, generate that image in the first step in their chain-of-thought and then use it as a reference to generate SVG code. It could be useful for much more than just silly benchmarks, there's a reason why physics students are taught to draw a diagram before attempting a problem.
- simonw 2y agoSomeone managed to get ChatGPT to render the image using GPT-4o, then save that image to a Code Interpreter container and run Python code with OpenCV to trace the edges and produce an SVG: https://bsky.app/profile/btucker.net/post/3lla7extk5c2u https://bsky.app/profile/btucker.net/post/3lla7extk5c2u
- qingcharles 2y agoDoes this match the rules of your test, or is it cheating? :)
- jonomacd 2y agoAnd the same thing with gemini 2.0 flash native image output. https://imgur.com/a/V4YAkX5 https://imgur.com/a/V4YAkX5 It's sort of irrelevant though as the test is about SVGs.