3 ms·

> On your specific point, humans take decades to (very roughly) copy themselves. An AI could do it in minutes with far more precision and control. Copying AIs

> On your specific point, humans take decades to (very roughly) copy themselves. An AI could do it in minutes with far more precision and control. Copying AIs just results in effectively higher intelligence (bigger brain). Things would be different with self-replicating robots of course, but duplicating robots is not that fast and one could argue that the robots are dangerous rather than the AI controlling them, because they would be dangerous even if controlled by stupid non-AI program.

dwaltrip 3y ago
Copying itself means it can do more “work” in the same amount of time. Earning money, strategizing, researching, smooth-talking humans, playing politics, and so on. Potentially even improving itself. These activities could give it power and influence.
- guy98238710 3y ago
  If you are very smart, chances are you will be able to obtain some power and influence. This is expected of AIs. Such effects can be however undone the same way you can undo effects of an explosion at a refinery (while punishing those responsible). The question is whether intelligence alone lets you expand power without bounds until you conquer the world. I just don't see how that would be possible.
  - pixl97 3y ago
    >The question is whether intelligence alone lets you expand power without bounds until you conquer the world. I just don't see how that would be possible. Name the next most intelligent animal to humans... Have humans completely and utterly conquered them? The intelligence explosion already happened and humans were it. Now you're questioning if it's possible with intelligence explosion 2.0?
    - c_crank 3y ago
      The intelligence explosion was useful to humans because humans can make more humans and command more resources. An AI can clone itself only on resources that humans make.

3 ms·

> On your specific point, humans take decades to (very roughly) copy themselves. An AI could do it in minutes with far more precision and control. Copying AIs

by guy98238710 3y ago

dwaltrip 3y ago
Copying itself means it can do more “work” in the same amount of time. Earning money, strategizing, researching, smooth-talking humans, playing politics, and so on. Potentially even improving itself. These activities could give it power and influence.
- guy98238710 3y ago
  If you are very smart, chances are you will be able to obtain some power and influence. This is expected of AIs. Such effects can be however undone the same way you can undo effects of an explosion at a refinery (while punishing those responsible). The question is whether intelligence alone lets you expand power without bounds until you conquer the world. I just don't see how that would be possible.
  - pixl97 3y ago
    >The question is whether intelligence alone lets you expand power without bounds until you conquer the world. I just don't see how that would be possible. Name the next most intelligent animal to humans... Have humans completely and utterly conquered them? The intelligence explosion already happened and humans were it. Now you're questioning if it's possible with intelligence explosion 2.0?
    - c_crank 3y ago
      The intelligence explosion was useful to humans because humans can make more humans and command more resources. An AI can clone itself only on resources that humans make.