4 ms·
Right. It would do nothing until we gave it a command to carry out. Personally, I would prefer it that way.
by hackinthebochs 13y ago
Right. It would do nothing until we gave it a command to carry out. Personally, I would prefer it that way.
- Houshalter 13y agoOnce it has a command to carry out, it is no longer idle. It has a goal, to fill out whatever that command is. If the goal you give it is not exactly the same as humanity's goals, then it could do things that were unintended, or things that conflict with our normal goals (i.e. you ask it to make money so it goes and robs a bank.) I seriously suggest reading these: http://lesswrong.com/lw/ld/the_hidden_complexity_of_wishes/ http://lesswrong.com/lw/ld/the_hidden_complexity_of_wishes/ http://wiki.lesswrong.com/wiki/Paperclip_maximizer http://wiki.lesswrong.com/wiki/Paperclip_maximizer
- hackinthebochs 13y agoInteresting ideas, not something I had previously thought of.