I don’t think the paper says anything about general problem-solving? They analyzed 40 reasoning problems and I didn’t find a list of them, but the example they

I don’t think the paper says anything about general problem-solving? They analyzed 40 reasoning problems and I didn’t find a list of them, but the example they use most often is “find the slope of a line.” Apparently there are many examples in the dataset demonstrating how to find the slope of a line, including computer code, and they all influence the answer. There are many ways you could ask a question about how to find the slope of a line, and the “generalization” going on seems to be unifying the different ways you could ask and answer this question. It seems fair to say that the LLM did learn to find the slope of a line? But the question has definitely been solved before, many times.