I thought the example in the article was a little artificial at first. Like why would you only have 12 requests if you have 12 backends? Reframing it in terms

I thought the example in the article was a little artificial at first. Like why would you only have 12 requests if you have 12 backends? Reframing it in terms of capacity cleared that up. If the rate of incoming requests is higher than the total rate your backends can process, your queues will grow infinitely! So something like an average of 12 incoming requests per second with each backend capable of processing 1 request per second is actually fairly realistic. And I think the math still works out the same there.