3 ms·
Predicting the next token is not at all the same thing as predicting the next action in a causal chain of actions. Not even close. One is model of language toke
by perrygeo 10mo ago
Predicting the next token is not at all the same thing as predicting the next action in a causal chain of actions. Not even close. One is model of language tokens, the other is a model of the physical world. You can come up with all sorts of predictions that can't be expressed cleanly in natural language. And plenty of things that parse cleanly from a language perspective but are unhinged in their description of empirical reality.