4 ms·
> thus history is irrelevant Then stop appealing to it as a reason that everything will be fine! We don't know what's going to happen and have no precedent, an
by cjbprime 3y ago
> thus history is irrelevant
Then stop appealing to it as a reason that everything will be fine! We don't know what's going to happen and have no precedent, and that is why this is a scary situation that requires thought.
> A hypothetical AGI isn't sharing a physical space with us.
That's not true, right? We would be competing for electricity and resources with it, at the least. Also, it is able to affect our physical space by persuading humans to do things it wants to do, which will have unpredictable and hard to defend against effects because of the whole superintelligence thing.
(Imagine, say, a version of the attack on the US Capitol, but on behalf of a leader that is orders of magnitude more charismatic and persuasive.)
> I mean, worst case scenario, shut down the internet infrastructure or reduce throughput significantly, right? It has to operate somewhere, even if that's across every online device.
Sure, persuading everyone in the world to all agree to turn off all communications devices -- when they've already presumably been convinced that they don't want to do that by a superintelligence -- sounds like an awesome plan that will totally work.