Edit: @visarga, I was kind of expecting you to tell me about the commas in arithmetic. I wonder whether you didn't because it's obvious to yo, too, that that is

Edit: @visarga, I was kind of expecting you to tell me about the commas in arithmetic. I wonder whether you didn't because it's obvious to yo, too, that that is evidence refuting the claim of learning out-of-distribution concepts. As in, yes, GPT-3 gets better at arithmetic with comma-separated values, but that's because the commas help it overfit even more.