6 ms·
They had to solve the car wash problem by hardcoding the solution in. The AI equivalent of adding another IF statement. They had to steal the work of researche
by MisterMunchkin 14d ago
They had to solve the car wash problem by hardcoding the solution in. The AI equivalent of adding another IF statement.
They had to steal the work of researches solving these open problems and then rewrite their solution. The AI equivalent of fraud.
- thinking_cactus 14d agoMeh. The car wash problem is an underspecified statement. It's like, hey, I just popped into existence and someone asked me if they should drive to the car wash nearby. It's not an insane assumption that the user isn't dumb and has some other reason to be asking the question other than it being a trick/stupid question (duh, if you want to wash your car you need to drive it to the car wash!). Taking it as some ultimate measure of intelligence simply doesn't make sense to me.
- selcuka 13d agoIt's not an ultimate measure of intelligence, but it's surely a measure of similarity to a real human being.
- BobbyTables2 13d agoI’ve also been wondering how many common problems have been hardcoded in the latest AI models…
- nearbuy 13d agoThey did not hardcode that, because: a) There's zero evidence of them doing so b) Some models released before the car wash problem was discovered would consistently get it right c) Hardcoding it is pointless. No one is seriously asking that. It's just a trick question. Hardcoding one trick question won't fix its weakness at other simple trick questions. d) Since it went viral on the internet, the next time they updated the knowledge cutoff, the LLM would likely be aware of the trick. It will fix itself without the labs doing anything special, even assuming the new models weren't smart enough to naturally figure it out.