3 ms·
The paperclip problem is the scenario in which you give an AI a small task (like making paper clips) and the AI goes too far to achieve that goal (enslaving all
by elil17 7y ago
The paperclip problem is the scenario in which you give an AI a small task (like making paper clips) and the AI goes too far to achieve that goal (enslaving all of humanity to make paper clips).
In the extreme case, specification gaming is the exact opposite: an AI will do anything in its power to satisfy the reward function without having to do any work, including tricking its creator into making the reward function easier
- antpls 7y agoOddly, that behavior looks very human. If the loopholes found by AI are related to energy conservation, that's a healthy result. Human students and workers need a fair amount of "work specifications" (years of teaching, decades of workplace laws and safety measure, etc) to actually complete the requested work that allows them to have revenue/salary. I don't see the specification game as an AI specific issue.