There's an option you can select in Google Now to specifically disregard these teams, either through the action menu on the card, or in the preferences section

There's an option you can select in Google Now to specifically disregard these teams, either through the action menu on the card, or in the preferences section of the Google Now app. Merely ignoring or swiping away the cards doesn't change Google's estimation of your preference of the teams.