>You can also load-balance on the client side. Clients connect to a management server, and the server tells them what percentage of connections to send to which

>You can also load-balance on the client side. Clients connect to a management server, and the server tells them what percentage of connections to send to which upstream. I don't think anyone has written any publicly available software to manage this, but it can use the same underlying protocol as Envoy's configuration servers I believe this is exactly the way that Hashicorp's Consul Connect service mesh is implemented for L7 routing.