3 ms·
"a lightbulb surrounding some plants" is a weird phrase and a human feeling pedantic might well come up with the picture shown. A more typical phrase would be
by emmelaich 4y ago
"a lightbulb surrounding some plants" is a weird phrase and a human feeling pedantic might well come up with the picture shown.
A more typical phrase would be "lightbulbS around some plants"
- note the plural.
Maybe I'm missing something but using non-typical language won't work when it's been trained on normal language.
- ivanbakel 4y agoI think you've misunderstood that example in the article. The AI isn't being asked to generate an image from the prompt, it's being asked to match the similar prompts to the different images. Winoground is basically a reading-comprehension test suite, which links back to the point made in the article that AI can't handle non-typical language precisely because it lacks reading comprehension (or any semantic model of language.) As the article points out, human runs of Winoground manage to match the vast majority of prompts to the correct image, so it's not a question of atypical language being too hard to understand. You may want to also read the author's other article[0] about the lack of semantic comprehension in AI models. 0: https://garymarcus.substack.com/p/horse-rides-astronaut https://garymarcus.substack.com/p/horse-rides-astronaut
- dane-pgp 4y ago"A lightbulb. Surrounding: some plants." https://frinkiac.com/img/S07E18/562995.jpg https://frinkiac.com/img/S07E18/562995.jpg