Sure, but I wouldn't consider it reward hacking if we knowingly gave it the goal of maximizing papercips and it did this. Maybe I'm being pedantic, but that wou

Sure, but I wouldn't consider it reward hacking if we knowingly gave it the goal of maximizing papercips and it did this. Maybe I'm being pedantic, but that would be a pretty clear due diligence failure on the prompter's fault.