6 ms·
Azure was having DNS issues
- hbcondo714 6y agoI wasn't able to get to https://status.azure.com/en-us/status https://status.azure.com/en-us/status either but now I can and everything shows "green" including Azure DNS
- Nelkins 6y agoHm...I'm not able to access the status page, but some of my coworkers are (as of 5:35 PM EST).
- PerfectElement 6y agoI'm seeing some errors in my applications, but most requests are still working somehow.
- NicoJuicy 6y agoPerhaps the errors are only partially logged. Since it's a DNS issue ( and potential DDOS)
- PlanetLotus 6y agoI haven't been able to get to the status page. I noticed the problem because I currently can't connect to Service Bus nor Storage.
- duncanawoods 6y agoWow - I can't even install dotnet on a linux machine because the packages repo is down.
- TrealTwan 6y agoCan't get to the status page even. Seeing issues with Microsoft Teams also.
- sv123 6y agoAlternate status page, of course showing all green across the board in typical Azure fashion. https://status2.azure.com/ https://status2.azure.com/
- dgritsko 6y agoThat link gives me a DNS error. Edit: Working now as of 6:08 PM EDT
- Spivak 6y agoDoes this have to be posted every time some cloud service has issues? We, as in people in this forum, know that status pages are worthless. They’re tools with the explicit purpose of reducing the burden on tier one customer support. That’s it. They are not a public monitoring platform.
- NicoJuicy 6y agoTheir health page was down too. This was the first place were i saw something. A colleague saw it on twitter. So yes, it's useful
- slaymaker1907 6y agoI was on support until a few minutes ago (SQL DB, not general Azure), and the status page was ironically my first indication something was up since said status page was having DNS issues.
- niij 6y agoHaving a fully up to date status page is what prevents useless repetitive cases during degradation or an outage. If I'm having issues but you show all green, I'm submitting a case.
- wahern 6y agoFor large incumbents, publishing a complete and accurate status page might not only be a recipe for bad press, but also lawsuits. There's significant downside and not much upside to telling the whole truth. It's entirely unsurprising that cloud providers like AWS or Azure would play definitional games w/ what constitutes an outage. Rolling 5m, 1% outage across your entire customer base? That's just a hiccup! If your staff has to field more confused questions and complaints, it's a relatively small price to pay.
- lwansbrough 6y agoportal.azure.com and status.azure.com are still down in NA Pacific.
- jrochkind1 6y agohttps://twitter.com/AzureSupport/status/1377737333307437059 https://twitter.com/AzureSupport/status/1377737333307437059 > We are aware of an issue affecting the Azure Portal and Azure services, please visit our alternate Status Page here https://status2.azure.com https://status2.azure.com for more information and updates.
- cmpb 6y agoWhich was also down until just a few moments ago. Seems like poor planning, but maybe it was just overloaded with requests
- reasonabl_human 6y agoThank goodness I’m not on call!
- NicoJuicy 6y agoHow do you know? Together with low TTL it seems plausible. But I don't understand how you can know it this fast.
- mdeeks 6y agoIcM is an internal tracking tool at Microsoft. It sounds like they looked at the tool and noticed this. I used to work there and use it as well.
- reasonabl_human 6y ago^
- jrochkind1 6y agoGithub is also having problems. https://www.githubstatus.com/ https://www.githubstatus.com/ Coincidence, or have they gotten around to moving some of their infrastructure to Azure since the MS acquisition?
- dgritsko 6y agoMy guess is the latter.
- lwansbrough 6y agoOur GitLab CI is failing due to https://mcr.microsoft.com/v2/ https://mcr.microsoft.com/v2/ being down.
- nijave 6y agoAfaik Actions (maybe Packages, too?) was always built on Azure. I think Github core is on bare-metal I'm guessing they probably get the elasticity of cloud while paying the wholesale or at-cost of the infrastructure (surely they get some discounts over the advertised price, at least)
- partiallypro 6y agoLet's Encrypt is also down and can't issue certs
- ficklepickle 6y agoDNS responses for our app servers in Azure were failing and now they are taking ~4000ms. They have a really short TTL too, which really exacerbates the issue.
- semicolon_storm 6y agoAzure is not having a good year. Two major Active Directory outages, a major CosmosDB outage, and now this.
- colpabar 6y agoThe sad part is that even though that feels like a lot given the time span, it doesn't feel that bad given it's Azure. These network issues have been plaguing us ever since we started using AD.
- Trisell 6y agoApparently AD doesn’t scale. Who know. /s
- yellowyacht 6y agoIs that all between January and April?
- EMM_386 6y agoNoticeable spikes across the board ... https://downdetector.com/ https://downdetector.com/
- colpabar 6y agoI have seen nothing to indicate this is the case, but is this what a DDoS attack looks like?
- collectedparts 6y agoCoinbase is ~completely down (?) I'm now seeing all outbound DNS lookups from my Heroku instances failing. What is going on?
- benatkin 6y ago"Serverless"
- deleted 6y ago[deleted]
- Narkov 6y agoIt's always DNS!
- x3n0ph3n3 6y agoThere have been some internal debates about setting up a secondary DNS in case Route53 somehow went down. My reasoning has thusfar been that if Route53 is down, there are probably other AWS services that we depend on that would also be down. What do you guys think? Is secondary DNS in this case worth it?
- aarmenaa 6y agoWe're moving towards dual DNS providers. We've been bit by DNS hosting failures too many times, and they're always painful because everything, including monitoring and control systems, end up dead or inaccessible. Not to mention the entire network being down is absurdly expensive if you're paying SLAs.
- balaziks 6y agoI guess the Protocol Police is doing its first major raid.
- nickdothutton 6y agoThey just cant seem to keep the lights on.
- NikolaeVarius 6y agohttps://azure.microsoft.com/en-us/updates/azuredns100sla/?cdn=disable https://azure.microsoft.com/en-us/updates/azuredns100sla/?cd... > Azure DNS is now being offered at a 100% availability SLA that's backed by our diverse, geo-redundant DNS infrastructure. > With this update, Azure DNS guarantees that valid DNS requests will receive a response from at least one name server 100% of the time. For details, see the SLA definition. This hasn't aged well
- xyzzy_plugh 6y agoIf I understand this correctly, everything unavailable is eligible for a 25% credit, and if the downtime exceeds ~4 hours then it's a free month. Neat!
- justizin 6y agofree month of azure DNS or free month of everything that you can't reach because DNS is down? ;)
- encryptluks2 6y agoWhichever they prefer
- Shadonototro 6y agoMost unreliable cloud provider
- dvfjsdhgfv 6y agoThese problems are actually good in that more organizations - especially big ones - realize that reliability is not something that you can outsource to a single provider and the problem magically disappears. Literally any service you depend on, from DNS to email, should be using redundancy so that when your basket gets squashed, you still have some eggs. Neither Amazon nor Microsoft will tell you that because vendor lock-in is in their best interest. You need to take care of it yourself otherwise you are completely at their mercy.