I think that one of the major issues is that people will use certain labels to help justifying behaving in a certain way, or avoid specific tasks and situations

I think that one of the major issues is that people will use certain labels to help justifying behaving in a certain way, or avoid specific tasks and situations. E.g. a ton of people hate talking on the phone, for reasons that are beyond me, and they will justify this is being introvert or having some sort of social anxiety, while at the same time being outgoing and extroverted in pretty much every other situation. As I grow old I've stopped trying to put labels on my behavior. They rarely fit and society expects that I act or believe in certain ways depending on how those labels are generally perceived.