I don’t really believe this is a paradigm shift with regards to train/test splits. Before LLMs you would do a lot of these things, it’s just become a lot easie

I don’t really believe this is a paradigm shift with regards to train/test splits. Before LLMs you would do a lot of these things, it’s just become a lot easier to get started and not train. What the author describes is very similar to the standard ml product loop in companies, including it being very difficult to “beat” the incumbent model because it has been overfit on the test set that is used compare the incumbent to your own model.