3 ms·
> My last employer one day had virtually every system fail in the world at the same time due to a hidden dependency on some routing in a single data center; it
by spookthesunset 4y ago
> My last employer one day had virtually every system fail in the world at the same time due to a hidden dependency on some routing in a single data center; it took 8 hours to restart all the systems since that had not happened before. It was a fun slack to follow.
I think every company eventually has at least once of these. It is usually a wake up call to the company that what used to work when they had N number of users no longer scales with 10x the traffic…
(It also usually has a lot of “I told you so” moments too)