6 ms·
Comcast's confirmed the fiber cut: https://twitter.com/comcastcares/status/1012767042158510080 https://twitter.com/comcastcares/status/1012767042158510080 > O
by JonathonW 8y ago
Comcast's confirmed the fiber cut: https://twitter.com/comcastcares/status/1012767042158510080 https://twitter.com/comcastcares/status/1012767042158510080
> One of Comcast’s large backbone network partners had a fiber cut that we believe is also impacting other providers. It is currently affecting our business and residential internet, video and voice customers. We apologize & are working to get services restored as soon as possible
They seem to be at least starting to route around it now; I was having intermittent connectivity issues to various sites here all morning, but as of ~45 minutes ago, I'm not having any issues reaching the sites I couldn't reach earlier.
- leesalminen 8y agoOur users are beginning to recover from the issue as well.
- tomatotomato37 8y agoFor the infrastructure-level network admins out there, is there different lingo for an intentional and accidental fibre break, or is "fibre cut" used for both? I'm just thinking 'cut' is a pretty intentional word to use here.
- mrrsm 8y agoA fiber cut can happen from innocent enough things, such as digging without getting the proper surveying done first.
- pwg 8y agoNot one of those admins, but generally the term "fibre cut" always seems to be related to "backhoe operator accidentally digging a hole through the buried fiber line" when the final reason for the outage comes out.
- AndyMcConachie 8y agoFiber cuts happen all, the, time. The reason users don't notice is because networks use redundant links. There's really no way to know without doing some serious investigation if it's intentional or not. But my guess would be accidental. A large network like Comcast/L3 is likely dealing with multiple cuts to fiber on a daily basis.
- troydavis 8y ago“cut” is used for both. Common causes are digging/construction work, maintenance by other carriers sharing the same right-of-way, weather (mostly for aboveground runs and equipment), and occasionally stuff like animals (“squirrel chew”), hunters shooting at things, and equipment failure that doesn’t fail over to redundant gear properly. Intentional, targeted damage is really rare, even when multiple paths experience concurrent outages. The fact that 2 paths were affected isn’t enough to assume it was intentional.
- calgoo 8y agoI have seen a lot of people digging up the fibre believing it's copper wires they can steal.
- onewhonknocks 8y agoSounds like it was 2 cuts, which likely means it was intentional IMHO: NY| Manhattan| Communication Failure| 30 Rockefeller Plaza (Comast)| Comcast is experiencing a National outage due to 2 fiber line cuts. One between NYC & Chicago, the second between Ashburn & South Carolina. customers urged NOT TO CALL 911, no ETA on a fix, police monitor Edit: source below. Thank you dfee.
- dfee 8y agoNon Bitly link: https://twitter.com/joangralla/status/1012761031922409473?s=21 https://twitter.com/joangralla/status/1012761031922409473?s=...
- onewhonknocks 8y agoThank you. Sorry I messed up the link.
- chatmasta 8y agoLol, customers call 911 when Comcast goes down?
- simonsarris 8y agoAnd they vote, too.
- zhengyi13 8y agoIs there any other source to suggest 2 cuts rather than one?
- thebluehawk 8y ago> customers urged NOT TO CALL 911 Do people really do this? I can't even comprehend this.
- TheSoftwareGuy 8y agoI'm wondering if their 911 service is having problems as a result. If that's the case then it's more of a "try not to need 911, but if you do try to use another network"
- cup-of-tea 8y ago> They seem to be at least starting to route around it now Isn't IP supposed to do this automatically?
- tlrobinson 8y agoIP itself doesn’t, that’s BGP. I’m not sure what it’s limitations around large links going down are though.
- walrus01 8y agoBest current info is as follows: There is a fiber cut somewhere between NYC and Chicago. At the same time there is also a fiber cut between Ashburn, VA, and locations in South Carolina. The cut is somewhere in NC. Copy and paste from Level3 notification system: "* CASCADED EXTERNAL NOTES 29-Jun-2018 15:13:37 GMT From CASE: 14815828 - Event Field Operations dispatched to the estimated failure location and upon arrival was advised by local law enforcement there was a truck that struck a utility pole, which then fell across the street and struck another pole, which then tore down the aerial fiber lines. In addition to the fiber lines being down, live power lines are down as well. OSP will be dispatching a fiber repair and construction crew to the site; however, until the local utility company has completed their repairs and deemed the area safe, fiber repairs cannot begin. * CASCADED EXTERNAL NOTES 29-Jun-2018 19:21:05 GMT From CASE: 14815828 - Event The OSP has contacted the personnel transporting the replacement fiber, and they advised they remain en route, and on schedule for their ETA of 20:15 GMT. The next update will be provided upon their arrival, or as new information becomes available.
- patejam 8y agoThere are massively important fiber lines being hung from a utility pole?
- walrus01 8y agoIt's more common than you think, a lot of long distance links between cities are a varied combination of aerial, direct buried trenched armored fiber, underground fiber in ducts. There are also a lot of long-distance links carrying DWDM traffic that are >95% aerial, not on poles that can get hit by trucks, with singlemode fiber inside high voltage AC transmission lines (https://3ee2108sdg.files.wordpress.com/2014/07/cropped-2014071011044635.jpg https://3ee2108sdg.files.wordpress.com/2014/07/cropped-20140...).
- patejam 8y agoYeah I understand aerial lines carried by those large towers shown in that image, but utility poles that can get hit by trucks seems problematic. Partly for accidental incidents like a truck crash, but also partly because of how easily it can become an attack vector. I guess the plus side is that utility pole lines are probably the easiest to fix when cut.