5 ms·
A similar outage happened in July last year: https://blog.cloudflare.com/details-of-the-cloudflare-outage-on-july-2-2019/ https://blog.cloudflare.com/details-of
by wenbin 6y ago
A similar outage happened in July last year: https://blog.cloudflare.com/details-of-the-cloudflare-outage-on-july-2-2019/ https://blog.cloudflare.com/details-of-the-cloudflare-outage...
- almost_usual 6y agoHow is a WAF regex similar to a route configuration error?
- lima 6y agoSimilar lack of peer review and change management process.
- michalhosna 6y agoNope, not at all. Read the damn thing. They tested it, the thing was correct, it overloded cpu, it wasn’t configuration mistake.
- lima 6y agoI read the damn thing: - No performance benchmarks for rules despite using a backtracking regexp engine. - No canary deployments, allowing the mistake to propagate to their entire network at once. A mature engineering organization is very unlikely to make such basic mistakes, because it has in-depth peer review for both design and implementation. Of course, their openness about the incidents is commendable and is the only reason why my company hasn't dropped them a long time ago, but it doesn't excuse such an easily avoidable downtime.
- bawolff 6y agoI dont think these are all that similar - different components, different types of overloads