>> Gains from scale are largest in areas such as reading comprehension, fact-checking, and the identification of toxic language, but logical and mathematical re

>> Gains from scale are largest in areas such as reading comprehension, fact-checking, and the identification of toxic language, but logical and mathematical reasoning see less benefit Left unsaid: it's much harder to learn shortcuts to fake performance in logic and reasoning and common arithmetic, than it is to do the same in "reading comprehension" and similar tasks for which there are no good benchmark datasets (most are basically multipl-choice tests that can be solved by a strong classifier without any need of anything like "comprehension") and for which there are no good metrics either (see BLEU score and friends).