5 ms·

You really shouldn't need more than a handful of load balancers (may one or two in a few different availability zones for HA). You can even pay Amazon and NGIN

• closeparen 10y ago
  One way to handle "service discovery" is to assign a distinct port to every service, run an haproxy on every host, and always make cross-service calls through localhost:port. Health checks and config management keep the haproxies up to date, and applications don't have to know which hosts to ring. Having only a handful of load balancers forces all your internal traffic through a handful of bottlenecks and points of failure, and you still need custom logic in your applications to try another load-balancer when the primary is dead.