3 ms·
LLMs have obvious limitations and a big contributor is the training data and the way they are trained in a supervised way. Although that is not as much of a lim
by ilaksh 3y ago
LLMs have obvious limitations and a big contributor is the training data and the way they are trained in a supervised way. Although that is not as much of a limitation as with most other AIs because of the "in-context learning" ability.
But that doesn't mean that future LLMs couldn't conceivably learn abstractions than are at a higher level or even perhaps inaccessible to humans in number of layers or complexity.
I think the obvious type of superintelligence that is only a few years away is what I call hyperspeed AI. LLMs are a very specific application which we will be able to accelerate greatly. Within a decade the output speed will be dozens of times faster than human thought.
Because they will have robust reasoning and extreme "thinking speed", these AIs will probably be connected to industry and military applications. Humans will need to be removed from the loop because waiting for a human decision means the competitors' AIs race ahead the equivalent of days or weeks.
If this is fine then it will create a precarious situation for humans where they are only nominally in control and things like advanced AI "viruses" might become very dangerous.
It's also certain that researchers will continue to develop new types of AIs that incorporate more animal (such as human)-like capabilities.