Using ControlNet with a depth map is very useful here, since it makes the modded building similar to the original exactly in the way the users identify it. It

Using ControlNet with a depth map is very useful here, since it makes the modded building similar to the original exactly in the way the users identify it. It reminds me of skins in a game like Overwatch – it's the shape that's the most important to make you able to identify a hero in split second, even if it's wearing a skin you have never seen before.