4 ms·

Could this happen to have been part of the massive CenturyLink/Verizon outage that's been rolling across the midwest the last day or 2? I know it's been a major

Could this happen to have been part of the massive CenturyLink/Verizon outage that's been rolling across the midwest the last day or 2? I know it's been a major pain in the butt for me, but I've been super productive at work not having to worry about answering calls.

walrus01 8y ago
network engineer for pacific NW ISP here: Yes this is absolutely centurylink related, from what I can observe that it's taken down, and I have my suspicions about Intrado. I think centurylink broke things further trying to fix this morning's DWDM/transport system outage. See the PDF file linked here: https://www.fcc.gov/document/april-2014-multistate-911-outage-report https://www.fcc.gov/document/april-2014-multistate-911-outag...
- alexeldeib 8y ago
  Appreciate the link, that was a very informative document (didn't finish all 40+ pages in the ~2 minutes to post this comment, of course).
- pishpash 8y ago
  I know it's not the same orgs, but Centurylink has had the most incompetent people I've dealt with as a retail customer.
  - walrus01 8y ago
    My totally subjective opinion: In US/Canadian telecom, any business formed from legacy near-monopoly ILEC (incumebent local exchange carrier) staff, they neither have a clue nor give a fuck. It's a corporate cultural attitude left over from days when ILECs truly were the last-mile monopoly carriers in many cities. In this case Centurylink is composed of former Embarq, Qwest (USWest) and other ILEC entities. My opinion also applies to entities like Bell, Telus, Verizon and Frontier. If you look at the people who run the core routers of their ASes, sure they know what they're doing, but they're so insulated from actually talking to a customer through myriad layers of corporate bureaucracy, that their clue level might as well be irrelevant.
    - nickpsecurity 8y ago
      You left off most important part: corruption. Paying politicians to block regulations and lots of competition, esp taxpayer-funded, lets them get away with this stuff. Even more so when one of their own is the regulator.
    - sitkack 8y ago
      Qwest was a much better company than Centurylink. All of my conversations with Centurylink quickly turn into some Malkovichian bizzaro world.
- mmmBacon 8y ago
  Was this 10G DWDM gear? Any idea who’s equipment and what root cause was? I’m just curious because I used to work for a vendor that supplied DWDM gear to Centurylink and wonder if this is equipment I designed. 10G DWDM is pretty robust so must have been a pretty massive failure, line amplifier, fiber cut, software upgrade, or something.
  - walrus01 8y ago
    nothing confirmed yet, it's all rumors and conjecture. https://fuckingcenturylink.com/ https://fuckingcenturylink.com/

walrus01 8y ago

network engineer for pacific NW ISP here: Yes this is absolutely centurylink related, from what I can observe that it's taken down, and I have my suspicions about Intrado. I think centurylink broke things further trying to fix this morning's DWDM/transport system outage. See the PDF file linked here: https://www.fcc.gov/document/april-2014-multistate-911-outage-report https://www.fcc.gov/document/april-2014-multistate-911-outag...

alexeldeib 8y ago
Appreciate the link, that was a very informative document (didn't finish all 40+ pages in the ~2 minutes to post this comment, of course).
pishpash 8y ago
I know it's not the same orgs, but Centurylink has had the most incompetent people I've dealt with as a retail customer.
- walrus01 8y ago
  My totally subjective opinion: In US/Canadian telecom, any business formed from legacy near-monopoly ILEC (incumebent local exchange carrier) staff, they neither have a clue nor give a fuck. It's a corporate cultural attitude left over from days when ILECs truly were the last-mile monopoly carriers in many cities. In this case Centurylink is composed of former Embarq, Qwest (USWest) and other ILEC entities. My opinion also applies to entities like Bell, Telus, Verizon and Frontier. If you look at the people who run the core routers of their ASes, sure they know what they're doing, but they're so insulated from actually talking to a customer through myriad layers of corporate bureaucracy, that their clue level might as well be irrelevant.
  - nickpsecurity 8y ago
    You left off most important part: corruption. Paying politicians to block regulations and lots of competition, esp taxpayer-funded, lets them get away with this stuff. Even more so when one of their own is the regulator.
  - sitkack 8y ago
    Qwest was a much better company than Centurylink. All of my conversations with Centurylink quickly turn into some Malkovichian bizzaro world.
mmmBacon 8y ago
Was this 10G DWDM gear? Any idea who’s equipment and what root cause was? I’m just curious because I used to work for a vendor that supplied DWDM gear to Centurylink and wonder if this is equipment I designed. 10G DWDM is pretty robust so must have been a pretty massive failure, line amplifier, fiber cut, software upgrade, or something.
- walrus01 8y ago
  nothing confirmed yet, it's all rumors and conjecture. https://fuckingcenturylink.com/ https://fuckingcenturylink.com/