3 ms·
Is being asked to read a clock really a gotcha?
by CooCooCaCha 1mo ago
Is being asked to read a clock really a gotcha?
- arjie 1mo agoNot if you are aiming at a general intelligence but it’s worth considering that this is a tool that may not be able to count the number of strawberries in the letter R but can still center a div.
- dghlsakjg 1mo agoIf I had to hire an engineer and there was one that could one shot the wang algorithm, but couldn’t read an analog clock, I would have no problem hiring them. Also worth noting that both models got it wrong. Qwen made a mistake that humans very good at reading clocks would make. Deepseek made a mistake that a human who had just learned to read clocks would make.
- CooCooCaCha 1mo agoIt would be different if AI was known to be reliable but it isn’t, so this is less of a random failure and more a symptom of jagged intelligence. And with every one of these there’s always an attempt to minimize the problem by saying it’s just one silly failure.
- ianmcgowan 1mo agoIt is, apocryphally, a gotcha test for Gen-alpha. As is being able to return the correct change or make a phone call to a human being. Reminds me of the iRobot line: "Can you create a symphony?", "No. Can you?".