article description is low on details but i don't think what you and OP are describing can be categorized as overfitting in the statistical sense and more like

article description is low on details but i don't think what you and OP are describing can be categorized as overfitting in the statistical sense and more like "reward hacking" by the model. like you said more likely than not the agent had access to bench source code and just fitted solution to that.