It's not super surprising that LLMs perform well on standardized tests, given that they have a lot of standardized test related text in their training data. The

It's not super surprising that LLMs perform well on standardized tests, given that they have a lot of standardized test related text in their training data. There are a lot of claims out there about the zero-shot ability of LLMs, and very little specific research to back it up. Until now that is.