4 ms·
I think the assumption that AI would have a natural motive to conquer things, or even to expand beyond the confines of its current resources, is flawed. The ab
by ForrestN 12y ago
I think the assumption that AI would have a natural motive to conquer things, or even to expand beyond the confines of its current resources, is flawed.
The absurdity of simultaneously fathoming the eventual death of the universe and also caring about accomplishing things and making decisions and living the particulars of one's life is uniquely human. We all know we're going to die, but we still spend lots of effort deciding about pizza toppings. (See Thomas Nagel's The Absurd).
Why would an AI care to do anything we didn't tell it to care about? There's no inherent link between being sentient and having the same psychological priorities as humans. We're irrational, and I don't think they will be.
- mercer 12y agoIs it not plausible that an AI modeled after humans is also likely to have human-like flaws such as the desire to conquer? The better we get at creating complex, human-like AI, the bigger the likelihood of unintended side-effects (leaving aside whether this is feasible in the first place, of course).
- ForrestN 12y agoI think we'll figure out how to make an intelligent being before we're able to figure out how to make an intelligent being that also harbors the subtle contradictions that make us human.