If small models keep improving for specific purposes and larger models have diminishing returns, then what? E.g. I can see a world where you have a local model

If small models keep improving for specific purposes and larger models have diminishing returns, then what? E.g. I can see a world where you have a local model that is specialised just for producing code.