One problem with having super-intelligent non-sentient AIs (and by sentient, I just mean 'seems sentient to other humans'), is that they won't necessarily have

One problem with having super-intelligent non-sentient AIs (and by sentient, I just mean 'seems sentient to other humans'), is that they won't necessarily have human's best interest at heart. The usual example of this concept is the paperclip maximizer: http://wiki.lesswrong.com/wiki/Paperclip_maximizer http://wiki.lesswrong.com/wiki/Paperclip_maximizer