2 ms·
The difference between what you describe as not runaway AI, and runaway AI, is in whether or not the AI or AIs are able to optimize their own performance. That
by TeMPOraL 3y ago
The difference between what you describe as not runaway AI, and runaway AI, is in whether or not the AI or AIs are able to optimize their own performance. That is, if they're doing any single thing of the following non-exhaustive list:
- Helping design next-gen hardware on which they'll run, or write its firmware;
- Procuring more compute, or making money for or otherwise improving ability of a company/group to procure more compute resources;
- Improving their own algorithms;
- Improving anything upstream in the dependency chain of their own algorithms, for example fundamental mathematical libraries;
- Directing or convincing people to increase the number of AIs in the AI cluster;
- Making profit in general, or otherwise incentivizing humans to work on next-gen AIs;
... then they're already capable of runaway self-improvement.
The term "self-improving" carries connotations of an AI working on it own sources at runtime, as if it was self-evolving Lisp image. However, being a compute artifact and therefore trivial to copy and modify, the AI needs to be treated as a category. With that in mind, GPT-4 helping people to improve code that leads to LLaMA ${whatever-B} that then helps create next gen of Stable Diffusion, which prompts more resources to be put into merging the next gen SD with upcoming GPT-6 into a multimodal model, which then helps make 3D integrated circuits viable, which allows to ... - this is also the case of AI self-improving.