4 ms·
LLMs cannot, as you put it, "properly, correctly think" So-called reasoning models are hallucinating, their self-reported "reasoning" does not reflect their in
by ForHackernews 8mo ago
LLMs cannot, as you put it, "properly, correctly think"
So-called reasoning models are hallucinating, their self-reported "reasoning" does not reflect their inner state https://transformer-circuits.pub/2025/attribution-graphs/biology.html#dives-cot https://transformer-circuits.pub/2025/attribution-graphs/bio...
(before someone comes at me, yes, humans can also lie about their inner state but we are [usually] aware of it. Humans practice metacognition and there's no evidence LLMs can distinguish truth from hallucination)
- 5o1ecist 8mo ago[flagged]
- ForHackernews 8mo agoI linked you a paper from one of the leading AI shops in the world demonstrating that the "Chain of Thought" reported doesn't match up with the actual activation inside the model, and you replied that you're an expert on some human psych stuff that may or may not even be real[0]. Forgive me if I don't immediately bow to your expertise. [0] https://pmc.ncbi.nlm.nih.gov/articles/PMC11293289/ https://pmc.ncbi.nlm.nih.gov/articles/PMC11293289/
- beej71 8mo agoBut we also at HN have historically called your experience "anecdata" and take it with a grain of salt. Don't take offense. Provide more data. I humbly suggest that a more hacker response would be, "That's really interesting that my experience doesn't agree with that study. Let's figure out what's going on."