If you haven't seen it yet, there's a fun thought experiment about these sorts of problems, named "the paperclip maximizer". The idea is that you have an AI mea

If you haven't seen it yet, there's a fun thought experiment about these sorts of problems, named "the paperclip maximizer". The idea is that you have an AI meant to manage an office, and you instruct it to "ensure it doesn't run out of paperclips". One thing leads to another, and eventually the AI is consuming all matter in the universe to construct additional paperclips. It's a silly idea taken to an extreme, but it's a fun idea: https://hackernoon.com/the-parable-of-the-paperclip-maximizer-3ed4cccc669a https://hackernoon.com/the-parable-of-the-paperclip-maximize... There's also a clicker game built around the concept: http://www.decisionproblem.com/paperclips/ http://www.decisionproblem.com/paperclips/