Yes, since GPT-4 is the one to beat, everyone is basically doing the equivalent of p-hacking their benchmarks. If you roll the dice sufficiently many times the

Yes, since GPT-4 is the one to beat, everyone is basically doing the equivalent of p-hacking their benchmarks. If you roll the dice sufficiently many times then only report on your best roll you can make it look like your model is better than it is.