2 ms·
This is why service health endpoints should be very carefully designed, with the proper balance between health inspection and performance penalty. That being s
by tilolebo 6y ago
This is why service health endpoints should be very carefully designed, with the proper balance between health inspection and performance penalty.
That being said, it's true that an ALB doesn't offer throttling capability like a true reverse proxy such as HAProxy provides, were you can cap the number of concurrent requests and give a chance to your backend to avoid death by overload.
I wish there would be a way for ASGs to at least make the distinction between an unhealthy instance and an overloaded one.