3 ms·
The superintelligent machine that people come to rely on for planning information and decision insights is the one we worry about becoming a slave? EDIT: I see
by wwweston 12y ago
The superintelligent machine that people come to rely on for planning information and decision insights is the one we worry about becoming a slave?
EDIT: I see some downvoting, I suppose I should explain.
First, I totally agree there are ethical issues to how you treat any intelligence.
But I've observed intelligent people who are in an ostensibly weaker/nominally inferior position manipulating people who are supposedly their superiors. Chances are pretty good you've seen it too. And that's just human-level intelligences manipulating other human-level intelligences. And we're imagining a superintelligence that leaves human intelligence in the dust, right? And on top of that, it's actually an intelligence that people come to essentially as supplicants for direction and knowledge.
Maybe if it has absolutely no insight into manipulating people it's safe. Maybe.