People have implicit or explicit reactions to things. Not trying to down play your experience here (your experience is still valid), but they probably are not i

People have implicit or explicit reactions to things. Not trying to down play your experience here (your experience is still valid), but they probably are not intentionally thinking or making a face. It's probably because this is new to them and not something they usually experience, so they do a double take and end up with a stare. I've done this will people wearing gloves recently, even though after 2 seconds of thinking about it I know there's rationale behind it. Try not to presume people are so quick to judge, rather that people are just feeling whatever they feel instinctively, and it is what it is. They probably don't even know why they feel what they do, it's just bad intuition not ignorance.