It’s the simplest metric to see how much of the model is reasoning and hiw much is just rehashing. If it can’t solve puzzles then it’s more likely to make mist

It’s the simplest metric to see how much of the model is reasoning and hiw much is just rehashing. If it can’t solve puzzles then it’s more likely to make mistakes when understanding questions that are out of its training set.