Apparently the scoring on a lot of difficult benchmarks can also be extremely influenced by something as simple as waiting for the model to exhaust its reasonin

Apparently the scoring on a lot of difficult benchmarks can also be extremely influenced by something as simple as waiting for the model to exhaust its reasoning, realize it hasn't come to a conclusion yet, and give it a simple prompt like "you can do this, I know you're capable, please keep going".