If the card didn't require a PIN, then they wouldn't need to torture you for it. They could just steal the card. So the risk to security has been moved to you

If the card didn't require a PIN, then they wouldn't need to torture you for it. They could just steal the card. So the risk to security has been moved to your physical person, making you less safe. All biometric security systems have the same issue.