I would say they are a fairly good measure of how well the model has integrated information from pretraining. They are not so good at measuring reasoning, out-

I would say they are a fairly good measure of how well the model has integrated information from pretraining. They are not so good at measuring reasoning, out-of-domain performance, or creativity.