3 ms·
Why would AIs want to do humans' dirty work?
by cpeterso 13y ago
Why would AIs want to do humans' dirty work?
- TeMPOraL 13y agoBecause we wrote that into AI's value system? (In a way that will survive self-modification of the AI's source code, of course. This is a very large and active topic of research.)
- baddox 13y agoStill, we would presumably see Darwinian effects in strong AI progression. My guess is that our ability to control AI value systems would end if we could no longer control the environment in which the AIs exist. And once the environment changes (perhaps due to AIs being installed in "actuators" like automobiles or industrial robots, or any conceivable change to a "software environment"), I think Darwinianism might select for a different value system than we intended.
- TeMPOraL 13y agoInteresting concept, never thought about it that way. I think separate AIs in "actuators" could (and should) be limited to sub-human level (there are also some interesting ethical reasons for that[0]) and without any significant self-modification capability to limit the risk. I believe that just building an intelligence will not prove to be the most difficult task - it seems much more complicated to build it in a way that will not end up with humanity dead (or worse). Friendly AI[1] is a bigger problem than General AI, and unfortunately it needs to be solved first. [0] - http://lesswrong.com/lw/x7/cant_unbirth_a_child/ http://lesswrong.com/lw/x7/cant_unbirth_a_child/ [1] - http://en.wikipedia.org/wiki/Friendly_artificial_intelligence http://en.wikipedia.org/wiki/Friendly_artificial_intelligenc...
- gjm11 13y agoIt's a large topic in the sense that it's a Really Hard Problem, and an active topic in the sense that there are a few people thinking hard about it. But I don't get the impression that it's something a lot of researchers are paying attention to. It's pretty much just the folks at MIRI (most famously Eliezer Yudkowsky, who posts on HN sometimes with id "Eliezer") and maybe FHI in Oxford. Or is there substantial work on this elsewhere?
- TeMPOraL 13y ago> It's a large topic in the sense that it's a Really Hard Problem, and an active topic in the sense that there are a few people thinking hard about it. That's what I meant (though maybe forgot to parenthesize it properly ;)); it's large because as I see it, it gets mind-bogglingly complicated quickly and branches into lots of different areas of maths, philosophy and computer science. It is an active topic, though unfortunately I haven't seen much research in it aside from MIRI and Oxford guys. I hope this will begin to change, as topics of AI seems to enter the global consciousness again (thanks to Google and Facebook employing high-profile AI scientists, transhumanism becoming more popular in the media, etc).
- scotty79 13y agoIf you find helpless animal do you do it's dirty work of providing it with food, water, shelter, some toys, some interaction? You do, provided that is not too much bother for you. I don't think we'll be too much bother for near omnipotent machines.