Size and nesting habit, yep. For example, mud daubers and allies need straight holes in wood, and so do carpenter bees, but they have different size preferences

Size and nesting habit, yep. For example, mud daubers and allies need straight holes in wood, and so do carpenter bees, but they have different size preferences. Social wasps need different sorts of shelters entirely for their nests, and honeybees a different sort again that we conventionally call "hive boxes".