3 ms·
> Most humans are not that good at reasoning themselves [...] I'd say most humans most of the time. Individual humans can do a lot better (or worse) depending
by eru 2y ago
> Most humans are not that good at reasoning themselves [...]
I'd say most humans most of the time. Individual humans can do a lot better (or worse) depending on how much effort they put in, and whether they slept well, had their morning coffee, etc.
> If anything, the current limits of these morels show the limits of human cognition which is spread throughout the internet - because this is literally what they learned from.
I wouldn't go quite so far. Especially because some tasks require smarts, even though there's no smarts in the training data.
The classic example is perhaps programming: the Python interpreter is not intelligent by any stretch of the imagination, but an LLM (or a human) needs smarts to predict what's going to do, especially if you are trying to get it to do something specific.
That example might skirt to close to the MuZero paper that you already mentioned as an exception / extension.
So let's go with a purer example: even the least smart human is a complicated system with a lot of hidden state, parts of that state shine through when that human produces text. Predicting the next token of text just from the previous text is a lot harder and requires a lot more smarts than if you had access to the internal state directly.
It's sort-of like an 'inverse problem'. https://en.wikipedia.org/wiki/Inverse_problem https://en.wikipedia.org/wiki/Inverse_problem