3 ms·
A better solution would be to simply configure the loadbalancer to have a maximum number of requests per second per endpoint and then to drop any requests over
by londons_explore 7y ago
A better solution would be to simply configure the loadbalancer to have a maximum number of requests per second per endpoint and then to drop any requests over that.
An even better loadbalancer will poll a load endpoint, representing CPU load, queue length, percentage of time GC'ing, or some similar metric, and scale back requests as that metric gets too high.
- MichaelApproved 7y agoMaybe their “load balancer” was just a simple round robin service which wouldn’t have those abilities.