8 ms·

For those out of the loop, this week has seen an outage from a bunch of major US internet companies: Cloudflare, Slack, Google Cloud, Azure, Facebook (including

• aristophenes 7y ago
  AMD has been shipping their new Epyc Rome server CPUs to hyperscalars for a few weeks now [1]. It seems to be a very appealing chip that a lot of them are adopting. They won't be the same as whatever they were using before, so it could be that major updates are needed to include them, meaning that it's just a risky time right now? [1] Second question in https://www.anandtech.com/show/14568/an-interview-with-amds-forrest-norrod-naples-rome-milan-genoa https://www.anandtech.com/show/14568/an-interview-with-amds-...
• basch 7y ago
  why is slack on that list, they use AWS. They arent an infrastructure provider.
  • the-dude 7y ago
    Nor is FB. It is about major outages.
    • basch 7y ago
      facebook absolutely is an infrastructure provider for a whole host of products including FB, Instagram, WhatsApp and more.
      • the-dude 7y ago
        Sure, you are absolutely right.
      • dunham 7y ago
        They also provide login (authentication) services for a number of sites.
    • scarcelycoher 7y ago
      Why aren't we outraged by outtages?
• tootie 7y ago
  Have any of them issues post mortems yet? Anything at all to indicate an attack of some sort?
  • molecule 7y ago
    “Cloudflare outage caused by bad software deploy“ https://blog.cloudflare.com/cloudflare-outage/ https://blog.cloudflare.com/cloudflare-outage/
  • walrus01 7y ago
    The one thing we can say with some certainty (Except for the first cloudflare outage about a week ago[1]), it's not BGP/routing table fuckery/IP space hijacks/people who don't know MANRs. There's lots of routing table monitoring services and big ISPs that run their own alerting/alarming systems. [1]: https://blog.cloudflare.com/how-verizon-and-a-bgp-optimizer-knocked-large-parts-of-the-internet-offline-today/ https://blog.cloudflare.com/how-verizon-and-a-bgp-optimizer-...
• OrgNet 7y ago
  They needed to connect NSA's new servers... /s
• walrus01 7y ago
  There's been a few major office365 outages that coincided with the Azure ones, we've taken to calling it office364 internally.
  • tcoff91 7y ago
    At this point it’s more like Office 361
    • walrus01 7y ago
      There have also been a few "nines" related jokes, as in: Hey, nine fives!
      • giancarlostoro 7y ago
        https://en.wikipedia.org/wiki/High_availability#Percentage_calculation https://en.wikipedia.org/wiki/High_availability#Percentage_c... I was a little confused by that phrase, so for anybody else who was as confused as me.
        • walrus01 7y ago
          "55.5555555% ("nine fives") " downtime per year: 162 days
• flylib 7y ago
  this is somewhat common
• mcqueenjordan 7y ago
  Interns join at the beginning of summer. \o/
  • saagarjha 7y ago
    Now might be around the time they’d start pushing to production, too…
  • leemailll 7y ago
    So we will have “eternal July” for internet outage?
  • draw_down 7y ago
    Come on.
• techrich 7y ago
  Its probably some back end access for five eyes, and needs a re-start of everything. Its too fishy for it just to a coincidence.
  • anbop 7y ago
    Could it be that people see an outage, migrate to a new vendor, and increase load?
    • deleted 7y ago
      [deleted]
• saltedshiv 7y ago
  Attackers and state actors sometimes appear to behave indiscriminately