3 ms·
Are people really balancing load based on simple cpu utilization for non-trivial services? That seems really surprising to me, but they present it as the curre
by lokar 2y ago
Are people really balancing load based on simple cpu utilization for non-trivial services? That seems really surprising to me, but they present it as the current best practice?
- jeffbee 2y agoIn my experience by far the most widespread solution for directing requests is randomly. Round robin is pretty popular. Everything more sophisticated than that is vanishingly rare outside of large organizations. Look in gRPC. What client side load balancers does it come with? Pick_first and round_robin. Weighted round robin has some traction but even in engineering groups with lots of experience and talent the complexity of measuring CPU rate utilization is underappreciated.
- sitkack 2y agoWhen reading a paper like this, ignore what the paper frames as the current state of the art, a lot of times. Often the research is framed in such a way that gives an impact boost by setting up somewhat of a strawman about the current state. Every production load balancer that I have come across in the last 10 years, load balances on the metric that is important to them.
- danielmarkbruce 2y agoAlso, replace "reading a paper" with "reading a startup pitch", "reading a company's marketing material" and any number of other things... Practically any time you ask a company what their value prop is you'll get a description as though we all just came out of the caves.
- sitkack 2y agoCuts to black and white video of someone struggling, visibly depressed almost panicked about opening a bag of potato chips. Cut to color video of happy relaxed individual after applying entirely obvious sold as-new load balancing heuristic.
- jldugger 2y agoI'm curious what you think kubernetes does, because AFAICT, cpu -- a metric available to hpa -- would be an _improvement_.