3 ms·
> When discussing artificial intelligence, a popular topic is recursive self-improvement. The idea in a nutshell: once an AI figures out how to improve its own
by cubefox 4y ago
> When discussing artificial intelligence, a popular topic is recursive self-improvement. The idea in a nutshell: once an AI figures out how to improve its own intelligence, it might be able to bootstrap itself to a god-like intellect, and become so powerful that it could wipe out humanity. (...) This is what people refer to as the fast takeoff scenario.
Recursive self-improvement is not a necessary condition for a fast takeoff. A strongly superhuman AI could emerge at training time. AlphaGo Zero went from subhuman to superhuman performance within a few hours. The same could happen with a general AI. A training run of a few weeks or even months would still be considered fast.