3 ms·
What the paper clip maximiser is doing is generating harmful unintended instrumental goals, such as killing the humans so that they can’t stop it making more Pa
by simonh 3y ago
What the paper clip maximiser is doing is generating harmful unintended instrumental goals, such as killing the humans so that they can’t stop it making more Paperclips.
- yanderekko 3y agoSure, but I wouldn't consider it reward hacking if we knowingly gave it the goal of maximizing papercips and it did this. Maybe I'm being pedantic, but that would be a pretty clear due diligence failure on the prompter's fault.