I don't think that was why it was considered unfair. The problem was rather that they tested on the same distribution the model had just seen 80 million exampl

I don't think that was why it was considered unfair. The problem was rather that they tested on the same distribution the model had just seen 80 million examples from.