I think where your mind is going is a form of Mccarthyism or "guilt by association." In a public conversation, connecting someone to a label like "anti-vaxxer"

I think where your mind is going is a form of Mccarthyism or "guilt by association." In a public conversation, connecting someone to a label like "anti-vaxxer" or "truther," even if you don't make the actual accusation is a form of slander. Then holding someone intellectually hostage and saying "I'm glad you're not X," as if I'm beholden to what you think of me, is sleazy to say the least. You might not be doing this consciously, but you are doing it nonetheless.