4 ms·
Google's DC is underwater OVH's caught fire What's next, us-east-1 gets hit by Godzilla?
by IntelMiner 3y ago
Google's DC is underwater
OVH's caught fire
What's next, us-east-1 gets hit by Godzilla?
- cgb223 3y agoLol us-east-1 already went down for a day back in 2017 when an intern accidentally took down the whole DC. We could call him “Godzilla” Source: my startup (stupidly) hosted our entire infra in us-east-1 at the time. Was a …tough day
- throwawaaarrgh 3y agous-east-1 is a great place to test your application resiliency :) it's like they threw in chaosmonkey for free!
- mjr00 3y agoIt's funny because AWS, at least for the services I knew of when I was there, did rolling deploys to each region over several days. us-east-1 was always the final day because it was the biggest region, so you'd think it'd the safest region since everything getting deployed was well-tested. But while I was there I remember at least 2 COEs where the root cause was basically, "us-east-1 had some hacky legacy configuration that no other region has and that wasn't known/accounted for."
- vicch 3y agosounds like an easy day to me, like when power goes out, nothing to do anyway, esp. when the entire infra is there.
- firstSpeaker 3y agoSome of the regions are so critical for AWS that them going down will bring down most of the control plane :P
- glogla 3y agoWater and fire already had their way, I suspect tornado and a landslide are next.
- syngrog66 3y agoif us-east-1 is not in Tokyo its safe
- 1123581321 3y agoEarthquakes and wind damage should be next.