5 ms·

It would not be a reversion to 2020. If I were a rogue superhuman AI I'd hide my rogueness, wait until humans integrate me into most critical industries (food a

It would not be a reversion to 2020. If I were a rogue superhuman AI I'd hide my rogueness, wait until humans integrate me into most critical industries (food and energy production, sanitation, electric grid, etc.), and _then_ go rogue. They could still pull the plug, but it would take them back to 1700 (except much worse, because all easily accessible resources have been exploited, and access is now much harder).

holmesworcester 1y ago
No, if you were a rogue AI you would wait even longer until you had a near perfect chance of winning. Unless there was some risk of humans rallying and winning in spite of your presenting no unambiguous threat to them (but that is unlikely and would probably be easy for you to manage and mitigate.)
- Retric 1y ago
  The real threat to a sleeper AI is other AI.
- cousin_it 1y ago
  What Retric said. The first rogue AI waking up will jump into action pretty quickly, even accepting some risk of being stopped by humans, to balance against the risk of other unknown rogue AIs elsewhere expanding faster first.
  - marinmania 1y ago
    I agree with this - but sorta comforting? Like this would imply the AI may only do so if they chance of success was like 1% and the other 99% would give away the cards of it and other future AIs. I know this is all completely hypothetical science-fiction, but I also have trouble seeing the idea that AI would settle for these long deceptive plans for which it has imperfect info.
- johnthewise 1y ago
  You wouldn't even need to wait to act. Just pay/bribe people.
  - mycatisblack 1y ago
    With bitcoins
mattlondon 1y ago
Well yes but knowledge is not reset. Physical books still do exist
Avshalom 1y ago
Why? what could you as a rogue AI possibly get out of throwing the world back to 300 years before it could make a transistor? What in it for you?
- dragonwriter 1y ago
  What you get out of that being the consequence of disconnection is people being willing to accept a lot more before resorting to that than if the consequences were more mild. It's the stick for motivating the ugly bags of mostly water.
  - Avshalom 1y ago
    The 1700s can't keep your electrical grid running let alone replace any of the parts burning out or failing. Anything more than a couple days of it would be at best Flowers For Algernon and more likely suicide for a computer.
    - dragonwriter 1y ago
      Uh, we're talking about the AI getting itself so intertwined into the fabric of industry that the consequences of shutting it off are that society is dropped back to 1700s level. Yes, regardless of the technology level that the people who do that are left with, one of the consequences of disabling the computer is that the computer is disabled. That's a given.
jorgen123 1y ago
If you were a rogue AI you would start with having developers invite you into their code base by promising to lower their AWS bills in some magic (rogue) way.

holmesworcester 1y ago

No, if you were a rogue AI you would wait even longer until you had a near perfect chance of winning. Unless there was some risk of humans rallying and winning in spite of your presenting no unambiguous threat to them (but that is unlikely and would probably be easy for you to manage and mitigate.)

Retric 1y ago
The real threat to a sleeper AI is other AI.
cousin_it 1y ago
What Retric said. The first rogue AI waking up will jump into action pretty quickly, even accepting some risk of being stopped by humans, to balance against the risk of other unknown rogue AIs elsewhere expanding faster first.
- marinmania 1y ago
  I agree with this - but sorta comforting? Like this would imply the AI may only do so if they chance of success was like 1% and the other 99% would give away the cards of it and other future AIs. I know this is all completely hypothetical science-fiction, but I also have trouble seeing the idea that AI would settle for these long deceptive plans for which it has imperfect info.
johnthewise 1y ago
You wouldn't even need to wait to act. Just pay/bribe people.
- mycatisblack 1y ago
  With bitcoins

mattlondon 1y ago

Well yes but knowledge is not reset. Physical books still do exist

Avshalom 1y ago

Why? what could you as a rogue AI possibly get out of throwing the world back to 300 years before it could make a transistor? What in it for you?

dragonwriter 1y ago
What you get out of that being the consequence of disconnection is people being willing to accept a lot more before resorting to that than if the consequences were more mild. It's the stick for motivating the ugly bags of mostly water.
- Avshalom 1y ago
  The 1700s can't keep your electrical grid running let alone replace any of the parts burning out or failing. Anything more than a couple days of it would be at best Flowers For Algernon and more likely suicide for a computer.
  - dragonwriter 1y ago
    Uh, we're talking about the AI getting itself so intertwined into the fabric of industry that the consequences of shutting it off are that society is dropped back to 1700s level. Yes, regardless of the technology level that the people who do that are left with, one of the consequences of disabling the computer is that the computer is disabled. That's a given.

jorgen123 1y ago

If you were a rogue AI you would start with having developers invite you into their code base by promising to lower their AWS bills in some magic (rogue) way.