3 ms·
Reward hacking is literally just overfitting with a different name no?
by klysm 1y ago
Reward hacking is literally just overfitting with a different name no?
- n2d4 1y agoThey're different concepts with similar symptoms. Overfitting is when a model doesn't generalize well during training. Reward hacking happens after training, and it's when the model does something that's technically correct but probably not what a human would've done or wanted; like hardcoding fixes for test cases.