Is there anything really wrong with sharing a PIN for all your cards? What sort of attack does this make easier? Maybe if someone sees you entering a PIN for on

Is there anything really wrong with sharing a PIN for all your cards? What sort of attack does this make easier? Maybe if someone sees you entering a PIN for one of your cards and then steals your wallet?