3 ms·
Doesn't do you any good if the outage is in the circuit breaking layer, which it was for GitHub (this started as a load balancer outage).
by jdm2212 1mo ago
Doesn't do you any good if the outage is in the circuit breaking layer, which it was for GitHub (this started as a load balancer outage).
- llama052 1mo agoIdeally you have levers further up from your local load balancers as well. Even at the edge. Granted you never want those to trigger but it’s better than fighting a storm while you fix things.
- otterley 1mo agoI wondered that myself. Curious as to why they couldn’t shed load at the edge to help protect goodput.
- Maxion 1mo agoIsn't that what they did though? Start returning more-or-less hardcoded 403s for the Copilot endpoint that was causing the issues?
- otterley 1mo agoThat’s more surgical than load shedding. With load shedding you intentionally return 503s to a proportion of all legitimate requests. It turns a hard blackout (total outage) into a flakiness issue.