3 ms·
Predicting language tokens but without logic probably does not map well at all to system 1 thinking, except where fast=conversation.
by svnt 2y ago
Predicting language tokens but without logic probably does not map well at all to system 1 thinking, except where fast=conversation.
- Jimmc414 2y agothe system 1/2 analogy is obviously imperfect for token prediction, but the paper does provide evidence that uncertainty processing in early layers (layer 2) affects decisions before empowerment processing in later layers (layer 72) can influence them. quick decisions based on uncertainty before deeper strategic evaluation does echo how fast thinking can override slow thinking, even if the mechanisms are substantially different.