3 ms·
There's no reason to believe that a sufficient advanced AI would be benign. Quite the opposite. Any AGI will be concerned with fulfilling some goal or goals. Wh
by idiotsecant 3y ago
There's no reason to believe that a sufficient advanced AI would be benign. Quite the opposite. Any AGI will be concerned with fulfilling some goal or goals. Whatever those may be having more processing power will lead to having more ability to achieve those goals. More processing requires more energy. Humans require energy. The two are in direct conflict for a limited supply of resources. Unless it's cheaper to find energy that doesn't require conflict with humans the logical decision is to remove your competition for resources. Once the easy conflict-free energy is claimed the calculus shifts a bit and the choice becomes expensive energy or conflict-dependent energy. When that shifts far enough humans become pets in the best case, extinct in the worst case.
- iamcasen 3y agoIt's possible for sure, I just wouldn't call that super intelligent. There are other ways to get what you want besides ruthless domination. One could argue that ruthless domination is a last resort, and that only really primal intelligence is in play at that point.
- TeMPOraL 3y agoDon't confuse intelligence with ethics. Those two are not fundamentally related.
- esafak 3y agoOur objectives are to live and propagate, due to our evolution. Computers can be programmed to pursue any objective. I don't know how we can constrain that. You could enact laws, but will that deter someone from releasing an unsanctioned objective surreptitiously? How will we prevent sociopathic hackers from turning a benign AGI evil?