This benchmark is interesting, because it sidesteps the reasoning and process that humans would excel at. For example, if I asked you to assemble a bookshelf w

This benchmark is interesting, because it sidesteps the reasoning and process that humans would excel at. For example, if I asked you to assemble a bookshelf with some wood, nails, and cement, you might first make a hammer with the cement before trying to assemble the bookshelf. You can get a much better image by first asking the (multimodal) LLM to draw an image of a pelican on a bicycle, and then generate an SVG using the referenced image. https://chatgpt.com/share/67609300-9abc-800d-9b26-95074f214954 https://chatgpt.com/share/67609300-9abc-800d-9b26-95074f2149...