3 ms·
> a superintelligent AI would still be constrained to the digital realm. That's already now only partially true, as outlined elsewhere. But a rogue persistent
by FabHK 20d ago
> a superintelligent AI would still be constrained to the digital realm.
That's already now only partially true, as outlined elsewhere. But a rogue persistent ASI would of course not willy-nilly attack humanity while humanity had a fighting chance, but create the conditions and methodically modify the world until at some point humans become superfluous to it.
> Nobody has yet proven that a superintelligent AI is possible
Sure, Eliezer Yudkowsky says that the probability that we'll all die given ASI is 100%, and you can argue that nobody has proven either that or even the possibility of ASI. However, a modified argument (e.g. that the probability that we'll all die given ASI is only say 50%, and the probability that we'll develop ASI also just 50%) still gives us reason to pause.