No architecture scales infinitely, you merely shift at each step what the next bottleneck will be. Even with small scale sites you'll see this: first, you need

No architecture scales infinitely, you merely shift at each step what the next bottleneck will be. Even with small scale sites you'll see this: first, you need to move from everything on one server to a load balancer plus app servers talking to a single database. Then you need to share your database. Then you need to move to multiple load balancers. Then so on and so forth, depending on the specifics of your service, mixed in with various rounds of local optimization at the application level that buy you just a little more time before having to ship another architectural change. Most distributed systems don't really scale ass you add nodes beyond a factor of 10 to 100. If they did, you wouldn't need to hire super expensive people to handle those systems.