4 ms·
Indeed, this is the main problem I run into. We have to scale up capacity before the traffic can be redirected or you basically double the scope of the outage b
by jldugger 3y ago
Indeed, this is the main problem I run into. We have to scale up capacity before the traffic can be redirected or you basically double the scope of the outage briefly. Which involves multiple layers of capacity bringup -- ASG brings up new nodes, then HPA brings up the new pods.
- Terretta 3y agoIf you have enough scale that could be a problem, cookie cutter more smaller AZs so any one outage is less of numerator of capacity over the denominator of scale. Worth noting that requiring teams to use 3 AZs is a good idea because you get "n" shaped patterns instead of mirror shaped patterns, which have very different characteristics for resilience and continuity.
- ec109685 3y agoIf there’s uncorrelated load you can also run on your hosts, then you can share their spare capacity, with the hope they don’t spike at same time. AWS does that with their lambda arch to reduce waste.
- jldugger 3y agoMaybe, but the cost accounting is already a nightmare.