> There is a strong impression that those models aren't just progressing along a scale, but changing qualitatively. I don't think that follows. We only get to

> There is a strong impression that those models aren't just progressing along a scale, but changing qualitatively. I don't think that follows. We only get to see GPT-2, 3, 4, not 2.5, 3.33, 3.95. We have no way to assess whether LLM performance is continuous or discontinuous. It's like if you gave me 3 different cars with 50 horsepower, 100 horsepower and 250 horsepower. I'd say that these cars aren't "progressing along a scale" but "showing radical leaps in performance" but in fact top speed does scale with engine power.