4 ms·
>>Does this imply that it was CloudFlare's trust of Internexa's announced BGP routing which caused or contributed to the outage? Did CloudFlare redirect traffic
by BuildTheRobots 12y ago
>>Does this imply that it was CloudFlare's trust of Internexa's announced BGP routing which caused or contributed to the outage? Did CloudFlare redirect traffic that it should have handled internally to Internexa? If so, isn't it more appropriate for CloudFlare to prioritize its own routes over those claimed by external parties?
"This downtime was the result of a BGP route leak by Internexa, an ISP in Latin America. Internexa accidentally directed large amounts of traffic destined for CloudFlare data centers around the world to a single data center in Medellín, Colombia. This was the result of Internexa announcing via BGP that their network, instead of ours, handled traffic for CloudFlare. This miscommunication caused a flood of traffic to quickly overwhelm the data center in Medellín. The incident lasted 49 minutes, from 15:08UTC to 15:57UTC."
The problem wasn't that cloudflair thought their IPs were somewhere else, the problem was that the rest of the internet[1] thought cloudflair lived in Medellin (somewhere else) and not with cloudflair.
[1] Complete hyperbole, but "huge swathes"[2] of the internet had the wrong idea.
[2] "The exact impact of the route leak to our customers’ visitors depended on the geography of the Internet. Traffic to CloudFlare’s customers sites dropped by 50% in North America and 12% in Europe. The impact on our network in Asia was isolated to China. Traffic from South America was also affected as data centers there had to cope with an influx of traffic normally handled elsewhere."
- biot 12y agoI understand what you quoted (refer to what I wrote in the second paragraph). If the problem is with the rest of the internet, why did CloudFlare quarantine the Medellín datacenter? To use an analogy, if your company's upstream phone provider redirected calls to your phone number to Siberia, what good does it do for you to quarantine Siberia?
- jgrahamc 12y agoWe quarantined it because it is connected directly to Internexa and we were unhappy with their accidental route leak.
- eastdakota 12y agoUnhappy is putting it mildly.
- astrange 12y agoIn this case, what does quarantining it mean?
- dsl 12y agoCan you explain "quarantined" a bit better? You make it sound like they are a transit provider. Did they "leak routes" you were passing to them?
- BuildTheRobots 12y agoThat's a good point; I'm hoping someone else can explain the definition of quarantine. As you say, if Medellin was announcing to the world they are cloudflair, cloudflair ignoring that doesn't seem to help ;)