The parent poster was talking about training longer but the model being kept at smaller scale so it would not be expensive to use in production. It's a trade-of

The parent poster was talking about training longer but the model being kept at smaller scale so it would not be expensive to use in production. It's a trade-off, you could train shorter with a larger model.