3 ms·
> However, we had never tested fully taking the entire PDX-04 facility offline. That is a painful lesson, but unless you are physically powering off the dc or
by __turbobrew__ 3y ago
> However, we had never tested fully taking the entire PDX-04 facility offline.
That is a painful lesson, but unless you are physically powering off the dc or at least disconnecting the network from the outside world you are not testing a real disaster.
You can point fingers at the facility operators, but at the end of the day you have to be able to recover from a dc going completely offline and maybe never coming back. Mother Nature may wipe it off the face of the earth.
- martinald 3y agoThis is a fair point. Imagine there had been a serious fire like OVH suffered or flooding that destroyed the data center. Would Cloudflare have been able to recover?
- creshal 3y agoMost likely, yes. They have enough customer lock-in that enough customers would stick with them even if it took them a week to rebuild everything from in other DCs.
- NicoJuicy 3y agoThat's not what happened here. Their edge worked fine. Business was mostly running as usual. The OVH outage was immediate downtime.