4 ms·
No matter how you structure your infrastructure shipping an update can bring down your system. You can make it less likely, but I don't know any company that ne
by Jensson 4y ago
No matter how you structure your infrastructure shipping an update can bring down your system. You can make it less likely, but I don't know any company that never bring down their systems with bad updates. Google does it, Amazon does it, Microsoft does it etc.
- bradhe 4y agoYour infrastructure should heal itself if it comes “down.” A decent release pipeline can fix this. Those companies don’t practice release moratoriums on Fridays.
- erik_seaberg 4y agoInfra won’t amend or refund bad transactions that were committed, I’ve seen a few people have to burn their weekends recovering from that.
- bradhe 4y agoAn exception should not dictate the rule. Sounds like there were some safety mechanisms missing. You indeed need a mature system (and engineering team) to manage this process.