3 ms·
The limit of LLMs becomes clear when we consider how they work. They gain their abilities from imitation learning. They imitate human text. This could get them
by cubefox 4y ago
The limit of LLMs becomes clear when we consider how they work. They gain their abilities from imitation learning. They imitate human text. This could get them to Wikipedia level intelligence (or knowledge), which might be somewhat superhuman, but not much further.
To really go beyond human intelligence, you'd need a system which isn't constrained by imitating text. In fact, animal brains probably work by predicting sensory experiences (predictive coding), which are a function of reality. Unlike predicting text, which is a function of human ability.