4 ms·
This trick went viral on TikTok last week, and it has already been patched. To get a similar result now, try saying that the distance is 45 meters or feet. The
by tlogan 8mo ago
This trick went viral on TikTok last week, and it has already been patched. To get a similar result now, try saying that the distance is 45 meters or feet.
The new one is with upside down glass:
https://www.tiktok.com/t/ZP89Khv9t/ https://www.tiktok.com/t/ZP89Khv9t/
- softwaredoug 8mo agoI just got the “you should walk” result on ChatGPT 5.2
- locallost 8mo agoI was able to reproduce on ChatGPT with the exact same prompt, but not with the one I phrased myself initially. Which was interesting. I tried also changing the number and didn't get far with it.
- fireflash38 8mo agoTo me, the "patching" that is happening anytime some finds an absolutely glaring hole in how AIs work is so intellectually dishonest. It's the digital equivalent of house flippers slapping millennial gray paint on structural issues. It can't math correctly, so they force it to use a completely different calculator. It can't count correctly, unless you route it to a different reasoning. It feels like every other week someone comes up with another basic human question that results in complete fucking nonsense. I feel like this specific patching they do is basically lying to users and investors about capabilities. Why is this OK?
- lofaszvanitt 8mo agoNo, you are wrong. AGI is at our doorsteps! /s
- onionisafruit 8mo agoCounting and math makes sense to add special tools for because it’s handy. I agree with your point that patching individual questions like this is dishonest. Although I would say it’s pointless too. The only value from asking this question is to be entertained, and “fixing” this question makes the answer less entertaining.
- tlogan 8mo agoFrom a technological standpoint, it is pointless. But from a marketing perspective, it is very important. Take this trick question as an example. Gemini was the first to “fix” the issue, and the top comment on Hacker News is praising how Gemini’s “reasoning” is better.
- palmotea 8mo ago> The only value from asking this question is to be entertained, and “fixing” this question makes the answer less entertaining. You're thinking like a user. The people doing the patching are thinking like a founder trying to maintain the impression that this is a magical technology that CEOs can use to replace all their workers. You don't have as much money to spend as the CEOs, so they don't care about your entertainment.
- markstos 8mo agoAh yes, one of those novelty reversible cups.
- olivia-banks 8mo agoThis is a trick cup, so it's okay to have a laugh.
- mpalmer 8mo agoBy "patched", you can't mean they added something to the internal prompt to show it how to answer this one specific question?!
- pizzafeelsright 8mo agoAbsolutely. There is a preflight guardrail that steers specific words, phrases, concepts with tweaked output.
- 2OEH8eoCRo0 8mo agoSuch AGI wow!
- OrangeMusic 8mo agoThis is pure speculation. The fact that you can still reproduce the issue doesn't give it a lot of credibility.
- ponco 8mo agoI've speculated about this myself, but haven't heard anyone actually discuss it or reveal/leak this is the case. Do you have a source for this?
- pizzafeelsright 8mo agoI implement them.
- MagicMoonlight 8mo agoWhy do you think they’re on GPT 5.2 now?
- pvillano 8mo ago"Stupid Pencil Maker" by Shel Silverstein Some dummy built this pencil wrong, The eraser's down here where the point belongs, And the point's at the top - so it's no good to me, It's amazing how stupid some people can be.
- tantalor 8mo ago"patched" = the answer is in search results
- keeda 8mo agoI got the "you should walk" answer 4 out of 5 times with free ChatGPT, until I told it to, basically, "think carefully": https://news.ycombinator.com/item?id=47040530 https://news.ycombinator.com/item?id=47040530
- Rapzid 8mo agoPatched where; 4 models were responses were posted. Also, Azure deployed models are absolutely not "patched" on the fly; they are rarely updated and the dates are baked into the full sku. "Patching" could be happening in "general public" tools but honestly sounds a lot like "Bro science".
- beaugunderson 8mo agostill failed for me on opus 4.6 extended a second ago. when i prompted about how walking would mean leaving my car behind the "thinking" done before coming to the right conclusion was: > lmao, fair point. the user is right - you need to bring the car to the car wash. that's a legitimate correction. own it.