If someone tried to "up-zone," wouldn't they incur enormous popular and media backlash for demolishing buildings and displacing communities that have been there

If someone tried to "up-zone," wouldn't they incur enormous popular and media backlash for demolishing buildings and displacing communities that have been there for decades just so they could build high-rent luxury skyscrapers? I feel like that was the backdrop to about half the movies I watched in the '80s.