3 ms·

Part of what we see as "human intelligence" comes from our biological origins. For example, intelligence AND emotions drive our actions: ambition, empathy, fear

Part of what we see as "human intelligence" comes from our biological origins. For example, intelligence AND emotions drive our actions: ambition, empathy, fear, greed, jealousy, love, etc. They are survival and reproductive mechanisms built into our brains based on the human condition. My response to the theory that an all-powerful computer intelligence will one day have us at it's whim is why would it even care? For the same reason it lacks empathy, it would also lack any ambition or fear or jealousy. The bigger risk is relying too much on A.I. built for very specific purposes (ANI). A contrived example would be putting A.I. in charge of managing the nuclear arsenal. A bug in the A.I. that caused a pre-emptive strike could wipe out all life on earth.

pjc50 9y ago
Indeed - the most likely dangerous kind of AI is the amoral servant; one that decides to massacre humans based not on its own volition but on the orders its has been given by a human.
throwanem 9y ago
I'm going to stay on the self-promotion train for one more stop, because I actually just a little while back started writing a long piece on a subject very much adjacent to what you're describing: https://aaron-m.com/2017/08/01/on-the-theodicy-of-system-shock-part-1 https://aaron-m.com/2017/08/01/on-the-theodicy-of-system-sho... Part 2, although I know where I intend to take it, is very inchoate at this point for a reason that I mention in a postscript to part 1. I'd love to have any feedback anyone would care to provide! It'll be of great use in improving the back half of the essay.