This is why you use configuration management tools. We have a similar architecture, with dozens of deployments for customers; upgrades are just a single command

This is why you use configuration management tools. We have a similar architecture, with dozens of deployments for customers; upgrades are just a single command that changes some configuration, and puppet does the rest. Until something goes wrong, 100 servers are no harder to upgrade than 1.