3 ms·
This is a fascinating blind spot I didn't know I had! Difficult to do much with as so many request/response load balancing software is inherently push based, b
by eximius 3y ago
This is a fascinating blind spot I didn't know I had!
Difficult to do much with as so many request/response load balancing software is inherently push based, but it's a great eye opener.
- adql 3y agoIt's not difficult. loadbalancer knows how many requests are in-flight to server. The OP is plainly wrong. That's why leastconn works in the first place. And leastconn is almost always one you want. It's almost magical. GC stall on one server ? That means it isn't processing, which means every new request will go to other servers. One server processing 2x as fast as the other ? Well, it keeps its connection count low, so it gets more of them
- CrimsonRain 3y agoWhat if a server has most of its request processing io blocked? It can process more requests because it has empty CPU RAM but load balancer will think the server is fully booked.