I think the negative is the birth rates falling too fast, resulting in an "unbalanced" population pyramid. If the birth rates were falling slowly, and stabilize

I think the negative is the birth rates falling too fast, resulting in an "unbalanced" population pyramid. If the birth rates were falling slowly, and stabilized at replacement, does it really matter where within reasonable range the population ends up?