I don't think this is an issue of free association. It's more an issue of: should your employer be able to make your employment contingent on the non-expression

I don't think this is an issue of free association. It's more an issue of: should your employer be able to make your employment contingent on the non-expression of your political views during your free time?