The issue with "free speech" is that it is often used as a crutch for people to cling to their bad ideas. "How dare those people take issue with that ridiculous

The issue with "free speech" is that it is often used as a crutch for people to cling to their bad ideas. "How dare those people take issue with that ridiculous thing I just said! I am just exercising my right to free speech!" So the "free speech only applies to the government" or the "free speech doesn't mean you can say whatever you want without consequences" argument is really just a reflex to "free speech" being often misused. But in this case - I agree with you. The knee jerk calls for the guy to be fired without really hearing him out or engaging substantively on the issues like censorship and an affront the free exchange of ideas upon which democracy depends.