2 ms·
Or you just have smarter load balancers, that realize when all of their servers are acting funky and stop taking servers out of rotation.
by azernik 9y ago
Or you just have smarter load balancers, that realize when all of their servers are acting funky and stop taking servers out of rotation.
- Terr_ 9y agoOr to riff on this idea further: You make the concept of a node's "relative stability" part of the load-balancer logic the same way that "relative idleness" is a factor. Then if all 100/100 nodes get taken down by some shared problem, the system simply degenerates into picking the idle-est of the 100.