> Optimizing tail latency isn't about saving fleet cost. Indirectly, it is. As the quote I replied to suggests, in order to combat tail latency services often

> Optimizing tail latency isn't about saving fleet cost. Indirectly, it is. As the quote I replied to suggests, in order to combat tail latency services often run with surplus capacity. This is just a fundamental tradeoff between the two variables mentioned. So, by improving the LB algo, they (and anyone, really) can reduce the surplus needed to meet any specific SLO.