Well except that feudal lords had to interact with the local population. It's where their food and servants came from, and if they were true feudal lords, part

Well except that feudal lords had to interact with the local population. It's where their food and servants came from, and if they were true feudal lords, part of their wealth in the form of tithes. They also were expected to raise local troops if necessary by their bosses, higher up the aristocratic hierarchy. If the feudal lords tried to behave as if their castles were bunkers, they wouldn't have lasted very long at all.