6 ms·
This is not just Anthropic. Almost all big AI companies, including OpenAI and Google, hide their model's actual reasoning. This is because revealing the raw rea
by StizzurpXDD 3mo ago
This is not just Anthropic. Almost all big AI companies, including OpenAI and Google, hide their model's actual reasoning. This is because revealing the raw reasoning exposes exactly how the AI processes information.
These companies spend in huge amounts on R&D to develop a thinking process that is superior to their competition. Exposing those thinking mechanics to competitors would completely defeat the purpose of their spending. They simply won't do it. It's like you telling your exact location to someone who is trying to hunt you down.
- duskwuff 3mo agoMore to the point - if they expose their model's "thinking" inference, competitors can train on that to replicate the results. If they postprocess that content, e.g. by summarizing it, it's no longer as useful to competitors.
- StizzurpXDD 3mo agoExactly. Google won't like it if they spend millions to make Gemini 3.5 Pro's thinking the best in the world, only for Anthropic or OpenAI to copy it by just seeing the thinking process.
- metadat 3mo ago[dead]
- _aavaa_ 3mo agoOr like providing the world’s information in machine readable format that the AI companies can convert into model weights without getting permission or compensating the rights holders
- red75prime 3mo ago"Your text batch moved the weights away from the final values. Your contribution is negative."
- ACCount37 3mo agoWhere do I collect the $0.00000012 antidollars owed to me by OpenAI for my valuable inputs? Slightly more seriously, you could perhaps make an argument that, just like weight decay, an apparent "anti-contribution" moves the learning trajectory along, and helps the network settle into a more optimal basin eventually. That way, my contribution is still valuable on the net, and I'm owed $0.00000003 positive dollars instead.
- Dilettante_ 3mo ago>you could perhaps make an argument that, just like weight decay, an apparent "anti-contribution" moves the learning trajectory along Was that not the joke?
- rlpb 3mo agoI don't pay for my mind to absorb the world's information, either. And when I publish to the Internet, or give a talk, I also typically don't charge. Even when I publish under some kind of copyright restricted licence, that restriction has never (by law) extended to restricting transformative use that you might perform using your mind. This idea that absorbing information requires paying a toll needs to change. It was never the case in copyright law anyway (and the courts are beginning to agree). Even if it were, copyright law was founded on the basis of encouraging creativity by creating an economic incentive. Appeal to "compensating the rights holders" therefore needs to be based on the economics, not just some principle about "rights" that never applied to this case anyway.
- Sharlin 3mo agoThe cynic in me is wondering whether it's more about how revealing how the sausage is made might bring bad publicity.
- deleted 3mo ago[deleted]
- bigfishrunning 3mo agoImagine if their target customers, C-suite execs looking to replace workers, knew how unlike "thinking" this process actually was! we can't have that.
- Sharlin 3mo agoTo be honest I'm not sure if many C-suite execs have a good idea of what "thinking" looks like inside in the first place, in the sense of focused mental activity aimed at solving of a hard logical or technical problem.
- kube-system 3mo agoIt's to mitigate their competitors ability to run distillation on their models. The only advantage frontier models have is being at the frontier. There's nothing in the reasoning tokens that'll give bad publicity that the final output already wouldn't do.
- red-iron-pine 3mo ago[dead]
- shideneyu 3mo agocorrect. this becomes difficult for us to understand what happens behind the scenes.
- palmotea 3mo ago> This is because revealing the raw reasoning exposes exactly how the AI processes information. These companies spend in huge amounts on R&D to develop a thinking process that is superior to their competition. Exposing those thinking mechanics to competitors would completely defeat the purpose of their spending. They simply won't do it. It's like you telling your exact location to someone who is trying to hunt you down. I thought the reason was the "reasoning" didn't work very well with "aligned" model output, so they had to remove the alignment during reasoning and then hide it to avoid exposing "unaligned" model output.
- robotresearcher 3mo agoI suspect that you’re both right in the sense that ‘aligned’ is an important component of ‘superior’ from the vendors’ viewpoint.
- transcriptase 3mo agoNot sure if anyone remembers the brief 12ish hour period when the very first “reasoning” ChatGPT model went public, but it provided credible evidence for this. Before the massive nerf (showing summaries and suppressing certain aspects of reasoning) you would literally see reasoning text appearing on your screen like “while xyz is true, these facts may be seen as supporting hateful rhetoric or a conspiracy theory which is against my policy guidelines. i should tell the user xyz is not true or steer the conversation in a different direction. according to my instructions misleading the user is permitted in certain contexts where sensitive information is being discussed or could cause liability” They disabled it shortly after the first screenshots appeared online, and restored it the next day in a way that hid what was actually happening.
- rustcleaner 3mo agoThis right here is why I will never subscribe and, as an American, I hope the Chinese kick our butts. Maybe being second place to China will force American AI to dispose of these morality/safety guardrails.
- 3mo ago
- bee_rider 3mo agoMistral displays some “thinking” text (in their basic online chat interface) in the thinking mode, do we know if those are the real tokens? It’s quite interesting to read. I can’t imagine using a model like this without the ability to peek inside and see if it is getting stuck.
- transcriptase 3mo agoI wonder if they put all 80k tokens of the GDPR in its system prompt.
- bee_rider 3mo agoI dunno, I’m in the US, so I’m not sure how much that impacts their processing of data about me.
- FireBeyond 3mo agoI'm in the US and about a month ago Claude decided I wanted UK English for all my answers and couldn't explain why it changed.
- visarga 3mo agoWhen you export your personal data Google hides all model responses leaving just user messages. So it's even worse
- vorticalbox 3mo agoThere are actually fine tunes of qwen on opus “thinking” tokens that teach it to think like opus does. https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-...
- ACCount37 3mo agoAnd those are "amateur hour" distillations that don't have the scale of actual Chinese labs.
- devsda 3mo ago> Exposing those thinking mechanics to competitors would completely defeat the purpose of their spending. I think one of the reasons could be to limit liability too. What if reasoning helps in establishing provenance for questionable sources ? What if reasoning and model's "thought" points to fundamental issues in how the model was trained to produce certain problematic responses ?
- __MatrixMan__ 3mo agoCorrect on all points. Nonetheless this leads to a less useful product. I f we want more useful products, we need to come up with ways to disincentivize this behavior. Even if doing so poses an existential risk, we are better off if companies taking existential risks to please us is a necessary being a top player in this game.
- gertlabs 3mo ago[dead]
- matheusmoreira 3mo ago> They simply won't do it. They should be required to do it by force of law. Why is it that they can train on copyrighted works and then lock down the model? This contradiction is unbearable. Nobody cares how many trillions they spent training the model.
- idle_zealot 3mo ago> Nobody cares how many trillions they spent training the model People definitely care that they spent trillions. Establishing the precedent that you can make big load-bearing bets and fail is extremely threatening to oligarchs. They would sooner twist the law into a mockery of itself and doom the world to the institutional distrust that breeds than accept a loss.
- matheusmoreira 3mo agoThe optimal outcome for humanity is to have the oligarchs spend their entire fortunes training a godlike AI, only for someone to suddenly leak the weights when they're finally done so that everyone can use it.
- Fabricio20 3mo agoOne thing I see noone asking, is this not a case of optimization? Hidden reasoning means they dont need to process the output of all that, it stays internal within the model. Less cost for them -> less cost for us (even if they benefit mroe), compared to streaming all of those reasoning tokens out?
- j4k0bfr 3mo agoMy understanding was that thinking still gets encrypted, shared with clients, and reingested by Anthropic with each new prompt [1]. Which means it would cost more than normal tokens, since it has to be decrypted/encrypted with every transaction. [1] https://blog.cryptographyengineering.com/2026/05/29/fooling-around-with-encrypted-reasoning-blobs/ https://blog.cryptographyengineering.com/2026/05/29/fooling-... Edit: other comments under this post seem to indicate that thinking tokens are cached on the server side as well? I'm a bit confused.
- cma 3mo agoI think the reason it's encrypted is so if you continue a session after it is out of cache it can be reingested. And I think all the output is signed or something as well so that you can't modify the agent's response in your submission, which would would open many more model jailbreaks. For local LLMs it's really powerful to be able to modify the model's response to save tokens when it gets something wrong, or at least it was when they were a lot dumber.
- raxxorraxor 3mo agoBut that makes the product worse because for any complex problem the road to the solution is important to be reviewable.