3 ms·
It’s a uselessly reductive statement. A person at a keyboard is also a next token predictor, then.
by dymk 1y ago
It’s a uselessly reductive statement. A person at a keyboard is also a next token predictor, then.
- HarHarVeryFunny 1y agoYes, but it's not ALL they are.
- deleted 1y ago[deleted]
- daveguy 1y agoThey are both designed, trained, and evaluated by how well they can predict the next token. It's literally what they do. "Reasoning" models just buildup additional context of next token predictions and RL is used to bias output options to ones more appealing to human judges. It's not a meme. It's an accurate description of their fundamental computational nature.
- adastra22 1y agoYes. That's not the devastating take-down you think it is. Are you positing that people have souls? If not, then yes: human chain-of-thought is the equivalent of next token prediction.