Most likely, it’s less generally smart than the top 2-4% of US high school students. It’s more like someone who trains really hard on many, many math problems,

Most likely, it’s less generally smart than the top 2-4% of US high school students. It’s more like someone who trains really hard on many, many math problems, even though most of them are not the replicas of the test questions, and get to that level of performance. Since the test questions were unseen, the result still suggests the person has some intelligence though. Note that there’s some transfer learning in LLMs. Training on math and coding yields better reasoning capabilities as well.