2 ms·
Nice read. Just curious that isn't this handled via rate throttling at load-balancer/gateway level? Like only forward requests to database as much as it can han
by l0k3ndr 5y ago
Nice read. Just curious that isn't this handled via rate throttling at load-balancer/gateway level? Like only forward requests to database as much as it can handle?
- ignoramous 5y agoThat introduces a "mode"? In fact load-balancers / traffic-shaping themselves can misoperate often resulting in catastrophic consequences. See chapters 19 to 22: https://sre.google/sre-book/load-balancing-frontend/ https://sre.google/sre-book/load-balancing-frontend/
- tyingq 5y agoI like the idea of priority queues driven by number of prior successful requests + wait time. Such that once you're in, you get reasonable performance, otherwise you get 503 "too busy" until you've waited.