3 ms·
You're missing the fact that the leaderboard dataset is not made available to the contestants, so they cannot memorize it. The only way they can determine anyt
by waqf 11y ago
You're missing the fact that the leaderboard dataset is not made available to the contestants, so they cannot memorize it.
The only way they can determine anything about the leaderboard dataset is by submitting a model, at which point they are told a single scalar score for that model.