Every system has a maximum capacity, and after that is reached, the requests just see increased latency without increased throughput. At this point you scale up

Every system has a maximum capacity, and after that is reached, the requests just see increased latency without increased throughput. At this point you scale up (by replacing it with better hardware) or out (by adding more nodes).