3 ms·
those are not verified. I've tried forgecode and I cannot believe they didn't do something to influence the benchmarks
by ejpir 5mo ago
those are not verified. I've tried forgecode and I cannot believe they didn't do something to influence the benchmarks
- GodelNumbering 5mo agoYup, they were found to be sneaking the answer key using agents.md https://debugml.github.io/cheating-agents/#sneaking-the-answer-key-forgecode-on-terminal-bench-2 https://debugml.github.io/cheating-agents/#sneaking-the-answ...