The question is not only how much it helped the AI model but rather how much it would have helped the human. This is because the AI model could have chosen to

The question is not only how much it helped the AI model but rather how much it would have helped the human. This is because the AI model could have chosen to run a search whenever it wanted (e.g. perhaps if it knew how to leverage search better, it could have used it more). In order for the results to be meaningful, the competitors have to play by the same rules.