4 ms·

> Foundation of modern society is built on the fact that cooperation trumps every other method of work You don't seem to be confident of this because: > gener

> Foundation of modern society is built on the fact that cooperation trumps every other method of work You don't seem to be confident of this because: > general purpose AI changes that equation to the point where other people are not only not necessary but also actively dangerous (threatening to take control). If you think coop is better than anything else, why an AI would think otherwise? edit: Are you saying that an AI that can solve problems better than any human can, can be way for some humans to threaten other humans?

moonchrome 11y ago
>If you think coop is better than anything else, why an AI would think otherwise? Again anthropomorphization - AI (in this scenario) doesn't "think" (as in have opinion) anything - you specify a problem - machine provides the solution. "I want X and Y" - it finds solution to solve X and Y. Even saying "it" feels wrong because it implies a single entity. No need for motivation - no self awareness - just a tool - sort of like a compiler (that can interface with real world with robots and whatnot - a weak analogy). >edit: Are you saying that an AI that can solve problems better than any human can, can be way for some humans to threaten other humans? Not even some humans - basically if you're the individual in control of such AI you will have a strong incentive to prevent others from gaining access - if you don't you give someone else the opportunity to take exclusive control. And besides - if you're capable of using such AI device you don't really need other people which is my point in the first place - society evolved not because of magic and harmony but because it's the most stable structure with the premise that cooperation (I shouldn't even say cooperation because there can be coercive societies that are still more efficient that individual) allows us to reproduce more efficiently. General purpose AI basically outperforms and replaces other people.

moonchrome 11y ago

>If you think coop is better than anything else, why an AI would think otherwise? Again anthropomorphization - AI (in this scenario) doesn't "think" (as in have opinion) anything - you specify a problem - machine provides the solution. "I want X and Y" - it finds solution to solve X and Y. Even saying "it" feels wrong because it implies a single entity. No need for motivation - no self awareness - just a tool - sort of like a compiler (that can interface with real world with robots and whatnot - a weak analogy). >edit: Are you saying that an AI that can solve problems better than any human can, can be way for some humans to threaten other humans? Not even some humans - basically if you're the individual in control of such AI you will have a strong incentive to prevent others from gaining access - if you don't you give someone else the opportunity to take exclusive control. And besides - if you're capable of using such AI device you don't really need other people which is my point in the first place - society evolved not because of magic and harmony but because it's the most stable structure with the premise that cooperation (I shouldn't even say cooperation because there can be coercive societies that are still more efficient that individual) allows us to reproduce more efficiently. General purpose AI basically outperforms and replaces other people.