3 ms·
https://www.anthropic.com/research/tracing-thoughts-language-model https://www.anthropic.com/research/tracing-thoughts-language... This article counters a sign
by ianbutler 2y ago
https://www.anthropic.com/research/tracing-thoughts-language-model https://www.anthropic.com/research/tracing-thoughts-language...
This article counters a significant portion of what you put forward.
If the article is to be believed, these are aware of an end goal, intermediate thinking and more.
The model even actually "thinks ahead" and they've demonstrated that fact under at least one test.
- Robin_Message 2y agoThe weights are aware of the end goal etc. But the model does not have access to these weights in a meaningful way in the chain of thought model. So the model thinks ahead but cannot reason about it's own thinking in a real way. It is rationalizing, not rational.
- Zee2 2y agoI too have no access to the patterns of my neuron's firing - I can only think and observe as the result of them.
- senordevnyc 2y agoSo the model thinks ahead but cannot reason about its own thinking in a real way. It is rationalizing, not rational. My understanding is that we can’t either. We essentially make up post-hoc stories to explain our thoughts and decisions.