3 ms·
That last part is truly fascinating. Seems to me that in order for robots to truly act like humans they need to have equal parts of (a) self awareness and (b) e
by threeseed 12y ago
That last part is truly fascinating. Seems to me that in order for robots to truly act like humans they need to have equal parts of (a) self awareness and (b) empathy. If you neglect to make the second part as sophisticated as the first you will inevitably end up with the situation in the movie.
- rbanffy 12y agoIt's fascinating, though, that the kind of empathy we need in superhuman robots is one we ourselves lack. Few of us can empathize with species we regard as inferior. If they are fundamentally different (as in "having an exoskeleton") the empathy becomes very rare.
- maroonblazer 12y ago>Few of us can empathize with species we regard as inferior. The large numbers of people who support animal rights would beg to differ. Plus, there's the whole category of domesticated animals many, many people arrange their lives around. Perhaps the greatest superintelligence risk to humanity is not something that resembles a human but rather a supercute Cockapoo.
- the8472 12y agoCuteness is a huge factor. Few people care about anglerfishes, while panda babies in a zoo are big news. As i understand it cuteness response is based on neotenic features, i.e. identifying and protecting babies. So maybe some people just wish to protect animals that happen to match patterns that we associate with our own species and not necessarily because they value an intact ecosystem.
- sukilot 12y agoAnimal rights supporters are "few of us".
- jsilence 12y agoI have a lot of empathy for my bees.
- qubex 12y agoNote that insofar as lack of empathy goes, Ava might be said to have the same lack of concern for the wellbeing of others as does Nathan, who like her manipulated Caleb for personal aims and like her seemed to be unconcerned about caging other sentient creatures. So it's all very entwined, at least in terms of storyline. Whether it's intentional or not I cannot really say.
- the8472 12y ago> Seems to me that in order for robots to truly act like humans they need to have equal parts of (a) self awareness and (b) empathy. They need much more than that. Basically a whole set of moral values[1] that closely align with those of humans. A bit of a simplified example: If you were to create an AI that maximizes human happiness as a primary goal you might end up with some sort of lotus eater machine with millions of humans in vats, experiencing their happiest moments in an endless loop, supported by drugs that enhance their endorphin release. Even if an AI were capable to analyze your emotional state and to follow your reasoning it doesn't mean it has to agree with it. Empathy does not prevent you from saying "I understand your pain, but I have more important things to do". [1] http://wiki.lesswrong.com/wiki/Terminal_value http://wiki.lesswrong.com/wiki/Terminal_value