Doesn't apply as long as the improvements obtained there scale with compute. Now, are there actual meaningful improvements to obtain, and do they stick around

Doesn't apply as long as the improvements obtained there scale with compute. Now, are there actual meaningful improvements to obtain, and do they stick around all the way to frontier runs? Unclear, really. So far, it looks like opening a can of hyperparameters.