May be it is time for conference organizers to explicitly make it clear that sexist, racist etc behavior won't be tolerated. If one makes an inappropriate joke

May be it is time for conference organizers to explicitly make it clear that sexist, racist etc behavior won't be tolerated. If one makes an inappropriate joke on the stage, ban that person for the next 1-2 years from the conference or something. This should apply equally to both men AND women (and transgender etc). People are naive, if they think only men make sexist jokes. However, if someone apologizes for stupid behavior, I don't see a point in continuously making noise about his/her behavior, even after the apology. This only adds noise, and doesn't contribute anything.