3 ms·
> Not only does the AI need to empathize and predict how typical humans react, they also need to be easy for humans to empathize with. Humans typically use them
by Izkata 8y ago
> Not only does the AI need to empathize and predict how typical humans react, they also need to be easy for humans to empathize with. Humans typically use themselves as a template for a reasonable range of reactions.
Hm, this past season of Westworld kinda touched on how this very particular thought can easily go wrong.
Trying to avoid spoilers, one of the programmers commented on how the teeny tiniest tweak to parameters created Hosts that would [motions to what they were watching, a normally-benign personality killing townspeople for fun]. The awake Host with him commented "it's gone insane". His response was something along the lines of, "in the range of possible actions, what humans call 'sane' only exists in a very narrow band".