There seems to be this viewpoint around runaway intelligence where people assume a “frictionless world with perfect spheres”. The truth is we don’t fully under

There seems to be this viewpoint around runaway intelligence where people assume a “frictionless world with perfect spheres”. The truth is we don’t fully understand what it means to be intelligent, and how intelligence scales. All indications are that intelligence comes with diminishing returns, in that to achieve small increases in intelligence requires large increases in connectivity. Even if we can design an intelligence that is generally smarter than us, and capable of building even smarter ai on its own, it’s intelligence might increase exponentially with each step, but each step could easily take increasingly longer amounts of time to achieve, leading to linear or even sub linear increases in capabilities over time. Resources are limited, hardware is limited, energy is limited. There are all sorts of constraints that are likely to play a limiting factor in runaway intelligence. This doesn’t mean that these intelligences won’t be dangerous. Even an average human can create a lot of trouble in this world. It does however mean that a singular AI is unlikely to just run away with things.