3 ms·
It is like asking a politician how much a coffee costs, to show how disconnected they are from common people. Super intelligence not being able to read a simple
by mejutoco 2mo ago
It is like asking a politician how much a coffee costs, to show how disconnected they are from common people. Super intelligence not being able to read a simple analog clock does the same.
> Sure, the model can’t tell me what time it is, but it can code the Wang algorithm for noisy audio matching in one shot
This is about a _vision_ model.
- dghlsakjg 1mo agoAn _experimental_ _flash_ _vision_ variant of a model optimized for speed and cost. The problem with judging a politician for not knowing what a cup of coffee costs is that it doesn’t tell you anything about his capabilities or why he doesn’t know. Maybe the politician is incredibly competent, but doesn’t drink coffee. Maybe he gets up at 5 to start working and makes a pot of coffee himself before the coffee shops open so knows what a bag of coffee costs but not a cup. The issue with a gotcha question is that it is a shortcut to confirmation bias. There is no single correct answer to what a cup of coffee costs, and not knowing the answer doesn’t tell you as much as people want it to. I can go to Starbucks and get a cup of “coffee” that costs $10, or I can go to the corner store and get one for $.99. I can make one at home for $.50 or less. There’s no right answer. Scroll through the comments and there is someone that tried the same clock test on this model and it answered correctly 9/10 times. That’s why catching someone or something in a gotcha once is kinda bad signal. Can this model tell time? Yes, and also no. Does a cup of coffee cost .99? Yes and also no.