Why should people in position of power get to choose what others should and shouldn't be offended by? Both with physical and verbal abuse, minorities and women

Why should people in position of power get to choose what others should and shouldn't be offended by? Both with physical and verbal abuse, minorities and women have been told by people in positions of power to toughen up. All we're seeing now is the repercussions of those marginalized folks getting their voice. I'm sorry you don't like it when they complain about being abused, but telling them to just toughen up is absolutely the losing position to take here.