All my life I thought free speech means everyone can voice his opinion, even if they are criticizing me. But obviously, this doesn't apply to criticizing people

All my life I thought free speech means everyone can voice his opinion, even if they are criticizing me. But obviously, this doesn't apply to criticizing people who are so obviously right. My bad...