25 ms·
> Caption: a red ball on top of a blue pyramid with the pyramid behind a car that is above a toaster. Have you ever heard humans talking like that? I bet you e
by joering2 4y ago
> Caption: a red ball on top of a blue pyramid with the pyramid behind a car that is above a toaster.
Have you ever heard humans talking like that? I bet you each person would also draw it differently. I consider myself human and yet I don't grasp a concept of a "car that is above toaster". What do they mean? Like hovering? Or just standing on the top? Cars aren't UFOs, they don't hover.
The whole paper seems like they tried to break the system with tasks even humans would have problems grasping. What's the point??
- theptip 4y agoIt’s like an IQ test. I think it’s a good way to probe the “cognition” (if you will) of the model. Sure, humans would probably differ in how they draw that picture. IQ 150 humans would almost all get the positional relationships correct though, even if the precise interpretation of “above” might differ. The fact that none of the images were correct under any interpretation of the relationships shows something meaningful, namely that this model can’t understand long chains of relationships.