The ones I'm aware of aren't in the middle of town, and by definition they can't be because they're holes in the soil landscape which is in short supply in the

The ones I'm aware of aren't in the middle of town, and by definition they can't be because they're holes in the soil landscape which is in short supply in the centre of a town. They're near small villages for which getting your family into hiding can be as simple as walking across the road into forests, ravines, etc. It'd actually be much easier to just herd your family into some nearby patch of wilderness than to shove them all into a hole in the ground without food, water, or toilet facilities. In any case hostile forces don't just teleport into your village, they're moving on foot and stopping to loot on the way, you've usually got weeks of warning that something bad is happening and days of warning that it's about to happen to you. The whole shelter theory just doesn't hold water.