If you are at a venue that is culturally-agreed-on for the purpose of socializing, and you don't have headphones in, then you should either leave or accept that

If you are at a venue that is culturally-agreed-on for the purpose of socializing, and you don't have headphones in, then you should either leave or accept that folks might try to socialize with you.