People who say that are usually people who define "racism" and "sexism" as "discrimination from a position of power" or "systemic/institutional discrimination".

People who say that are usually people who define "racism" and "sexism" as "discrimination from a position of power" or "systemic/institutional discrimination". For them, just because men or whites are statistically more likely to be powerful, men and whites are powerful and "privileged" in general. Who cares about poor whites and homeless men! I think that's pure bullshit, but a lot of people apparently feel the opposite.