3 ms·
Summary: On August 30, 2020 10:04 GMT, CenturyLink identified an issue to be affecting users across multiple markets. The IP Network Operations Center (NOC) w
by dz0ny 6y ago
Summary: On August 30, 2020 10:04 GMT, CenturyLink identified an issue
to be affecting users across multiple markets. The IP Network Operations
Center (NOC) was engaged, and initial research identified that an
offending flowspec announcement prevented Border Gateway Protocol (BGP)
from establishing across multiple elements throughout the CenturyLink
Network. The IP NOC deployed a global configuration change to block the
offending flowspec announcement, which allowed BGP to begin to correctly
establish. As the change propagated through the network, the IP NOC
observed all associated service affecting alarms clearing and services
returning to a stable state.
Source https://puck.nether.net/pipermail/outages/2020-August/013229.html https://puck.nether.net/pipermail/outages/2020-August/013229...
- kitteh 6y agoFlowspec strikes again. Its a super useful tool if you want to blast out an ACL across your network in seconds (using BGP) but it has a number of sharp edges. Several networks, including Cloudflare have learned what it can do. I've seen a few networks basically blackhole traffic or even lock themselves out of routers due to a poorly made Flowspec rules or a bug in the implementation.
- parliament32 6y agoIs "doing what you ask" considered a sharp edge? Network-related tools don't really have safeties, ever (your linux host will happily "ip rule add 0 blackhole" without confirmation). Every case of flowspec shenanigans in the news has been operator error.
- mrguyorama 6y agoIt's possible that if a tool allows you to destroy everything with a single click, that tool (or maybe process) is bad