Improvements will not come from collecting more and more samples for current large models, but will come from improvements to algorithms, that also may focus on

Improvements will not come from collecting more and more samples for current large models, but will come from improvements to algorithms, that also may focus on improving the quality and use of input data. I don't think there is such a clear separation between algorithms and data as your comment suggests.