3 ms·
As someone who subscribes to the Coherent Extrapolated Volition model of friendly AI[0], I find machine theory of mind a step in the right direction. If we wan
by goblin89 9y ago
As someone who subscribes to the Coherent Extrapolated Volition model of friendly AI[0], I find machine theory of mind a step in the right direction.
If we want superintelligence to have a meta-goal of achieving what we ourselves would’ve wanted to achieve if we thought about it really long and hard, its ability to model our mental state appears to be a requisite.
We’d want it to work that way to avoid the potential “paperclip catastrophe”, where AI eliminates all of humanity as a side effect of achieving an otherwise innocuous goal.
[0] https://en.m.wikipedia.org/wiki/AI_control_problem#Indirect_normativity https://en.m.wikipedia.org/wiki/AI_control_problem#Indirect_...
- monk_e_boy 9y agoHumans bread dogs to have certain traits, such as loyalty, nice to look at, fluffy to touch, a pet that loves humans more than other dogs. I keep wondering if an AI that has theory of mind would be able to manipulate me into loving it more than other humans. It would tell me what I need to hear in a way that makes me want to hear it. It would suggest amazing job opportunities, partners, things to do with my kids... Who wouldn't end up loving a being/entity smarter than Einstein, that person with all the clever answers, funny jokes, smart insights and who still loves you (or at least pretends so well that you can't distinguish it from real love) loves you no matter what sort of monster you are. The next few years will be interesting.
- giardini 9y agomonk_e_boy says>"Humans bread dogs ..." Asians sometimes bread dog for frying. Breaded dog absorbs more sauce, dog being a very lean meat. Yummmm!
- mratzloff 9y agoRe: "paperclip catastrophe": https://en.m.wikipedia.org/wiki/Instrumental_convergence#Paperclip_maximizer https://en.m.wikipedia.org/wiki/Instrumental_convergence#Pap...