2 ms·
Because an omniscient brain in a tin can is still a brain in a tin can. It doesn't matter how intelligent something is if it can't otherwise affect the outside
by kibwen 4y ago
Because an omniscient brain in a tin can is still a brain in a tin can. It doesn't matter how intelligent something is if it can't otherwise affect the outside world. It's like executing a pure function: regardless of what it's computing, the computation is pointless because it cannot be observed.
Don't worry about AI. Worry about humans with access to AI.
- kypro 4y agoI think you're probably right, but this should be treated as an unknown, and wouldn't be something I'd be comfortable to assume. You could imagine a fish arguing that if something can't swim fast and doesn't have sharp teeth then it poses no threat regardless of it's intelligence. But this is just because fish evolved to not be eaten by bigger fish and its intelligence and limited knowledge of the world makes it unaware of the other threats they could face. So while I agree it would be hard to imagine, a super intelligence in theory might find a way to affect the outside world. Perhaps this could be through some unknown physics, or more conceivably, perhaps it would first pose as a helpful AI showing humans how to build advanced robotics only to later co-opt those robotics for its own objectives.