4 ms·
Look at the tasks in the benchmark (see §2 https://arxiv.org/html/2503.14499v3 https://arxiv.org/html/2503.14499v3)
by Leynos 5mo ago
Look at the tasks in the benchmark (see §2 https://arxiv.org/html/2503.14499v3 https://arxiv.org/html/2503.14499v3)
- MadxX79 5mo agoYeah, what about them? As far as I read it the tasks are fixed. The AI companies should know the tasks by now, and have overfitted their models on the tests by now, in the same way I'm implying I overfitted my model to reproduce Harry Potter.
- Leynos 5mo agoYou can choose to believe that.