6 ms·
It is pretty nuts that a single physical location can bring down a state's worth of 911, and cellular. It is either institutional incompetence, or malice, or l
by unethical_ban 6y ago
It is pretty nuts that a single physical location can bring down a state's worth of 911, and cellular.
It is either institutional incompetence, or malice, or laziness.
- nexuist 6y agoIt also perfectly explains why this specific building at this specific location was chosen out of all of the other possibilities. Someone knew about this weakness.
- gbh444g 6y agoWhoever designed the system didn't know about the Paxos protocol.
- h2odragon 6y ago> institutional incompetence, or malice, or laziness. AT&T in TN is an epic example of all 3 and then some. The most recent unbelievably stupid thing I've personally observed was the construction of 15 miles of new fiber on county power poles; right beside a Verizon fiber line that had been there for a decade. They put no slack loops in theirs, VZW's run has many. that line went up this year, and has been torn down and out of service 3 times, so far, that I know of. Oddly I hear the VZW line keeps failing shortly after the ATT trucks are seen, where I dont recall hearing much about failures on the VZW before this year. So perhaps there was a design consideration that suggested the construction method.
- Sylamore 6y agoI can't speak for the telco side of the business, but I do know that AT&T leadership has been telling their enterprise IT side of the business to throw out many prior requirements to built HA into things, and to reduce the portion of systems set aside to handle unplanned events. One of the justifications has been that such planning and built-in headroom is virtually never used. They are rapidly shutting down most of their enterprise IT data centers and the planning was done without consulting with their system architects about things like site paring for EBR and data replication, network coverage, etc.
- soniman 6y agoATT has more debt than the Phillipines, it's no surprise that they're trying to cut costs.
- MichaelZuo 6y agoBut what are their financing rates? They conceivably could have better long term security due to their position. And thus be fine with a higher debt loading. Utilities, at least those with a monopoly license, are quite close to State-owned-enterprise (SOEs).
- soniman 6y agoYou think they're going to pay off $168,000,000,000 of debt at the current rates? Maybe. If not, watch out.
- MichaelZuo 6y agoWell if they have a monopoly in certain areas/sectors and the only alternative to raising prices is bankruptcy... I’m pretty sure they can raise prices arbitrarily. That actually raises an interesting question, how are monopoly licenses valued? If their value can be bumped up every year on the balance sheet...
- DangitBobby 6y agoWhy do they have so much debt? Aren't they profitable?
- hakfoo 6y agoI'd expect they've got a LOT of baggage. They have the ex-SBC copper-wire networks they probably wish they could shed (compare when Verizon basically refused to rebuild damaged infrastructure after Hurricane Sandy). But they also went all-in on pay TV, buying DirecTV at a premium price just as cord-cutting became a thing. I wonder if we'll eventually see an "Amtrak" style nationalization for our POTS and related infrastructure. The firms with nothing sexier in their portfolio (Frontier) are frequently unhealthy, and the ones that do have other things to sell (Verizon, AT&) don't give it their full attention. It's no longer a competitive commercial product, but it serves enough of a public interest (i. e. not breaking a billion POTS-attached alarms, the high resiliency in natural disasters) that it can't just be dug up and scrapped for copper.
- phil21 6y ago> It is either institutional incompetence, or malice, or laziness. If so it's endemic. I think many of us in the "telecom infrastructure" adjacent industries are thinking of more than a handful of much more impactful and less hardened targets. Certainly a sobering Christmas.
- kitteh 6y agoLack of redundancy due to cost probably has something to do with it. Same issue with internet peering in quite a few cities (no viable 2nd location, costs a lot of money to double up the gear, additona optical transport).
- konjin 6y agoNot to mention that in far two many places the second location is on the other side of the river from the first. I was in finance when I looked up the physical address of our back up data center which was in another city ... 5km up stream from our main data center, both were within the 30 year flood plain of the river.