This isn’t what would happen. Even we had a huge number of inexplicably needed leap seconds (there are 3600 seconds in an hour), local offsets would just change

This isn’t what would happen. Even we had a huge number of inexplicably needed leap seconds (there are 3600 seconds in an hour), local offsets would just change, for the same reason that people on the other side of the planet have a different time on their watch than you do. And if for some reason we proved incapable of doing that, then social conventions on when the work day started would shift relative to the local time. There just is no danger of people going to work at sunset. I’m not saying that abandoning leap seconds is a good idea, just that abandoning them wouldn’t consign future generations to whacky schedules.