4 ms·

Looks like it's started with a DNS outage @ Level3: https://downdetector.com/status/level3/map/ https://downdetector.com/status/level3/map/

mrmondo 8y ago
We thought that too - gwmigprda.aadg.windows.net.nsatc.net seems / seemed to be failing to resolve, but then it seemed like it was internal to their infrastructure - which they later added to their status page (and clarified it was their authentication infrastructure which needed to be 'rebooted').
est31 8y ago
I don't understand, could you explain? Level3 may be the biggest backbone provider but I doubt that Microsoft is peering only with them are they? This is maybe something that a smaller company might do but Microsoft seems too large for that.
- stonogo 8y ago
  Wording of the communication to my organization indicated that Level 3 is handling some subset of Azure-internal networking. I don't think it's a peering issue.
  - est31 8y ago
    Thanks!
zeeZ 8y ago
My ISP (Telefonica) currently doesn't return addresses for login.microsoftonline.de (cloud Germany) while Google's DNS servers do. I wonder if that's related.
- mrmondo 8y ago
  Interesting, I suspecting their 'restart' of 'authentication infrastructure' may be a rolling restart and perhaps they have not got to Germany yet, perhaps by using Google's DNS different 'authentication infrastructure' is being provided?
- snitch182 8y ago
  Moving to another Provider might involve shifting to other ips. Probably sucks to be working there right now.
maltalex 8y ago
Perhaps it's related to the DNS flag day [0] that's coming up on Friday? [0]: https://dnsflagday.net/ https://dnsflagday.net/
- fanf2 8y ago
  Certainly not, because it hasn’t happened yet
  - chrismorgan 8y ago
    Not certainly not. Hypothetical scenario: realise something in your infrastructure will have problems in a few days’ time, and so make changes, which accidentally break things.
  - Godel_unicode 8y ago
    You've never made a change in advance of an upcoming problem that accidentally broke something else? Lucky...
Bombthecat 8y ago
Ouch, level3 is pretty big. How could they have an outage?
- tallanvor 8y ago
  Level3 is not exactly known for being rock solid.
tinus_hn 8y ago
Why would Microsoft be using a third parties DNS? It’s trivial to host it yourself.

mrmondo 8y ago

We thought that too - gwmigprda.aadg.windows.net.nsatc.net seems / seemed to be failing to resolve, but then it seemed like it was internal to their infrastructure - which they later added to their status page (and clarified it was their authentication infrastructure which needed to be 'rebooted').

est31 8y ago

I don't understand, could you explain? Level3 may be the biggest backbone provider but I doubt that Microsoft is peering only with them are they? This is maybe something that a smaller company might do but Microsoft seems too large for that.

stonogo 8y ago
Wording of the communication to my organization indicated that Level 3 is handling some subset of Azure-internal networking. I don't think it's a peering issue.
- est31 8y ago
  Thanks!

zeeZ 8y ago

My ISP (Telefonica) currently doesn't return addresses for login.microsoftonline.de (cloud Germany) while Google's DNS servers do. I wonder if that's related.

mrmondo 8y ago
Interesting, I suspecting their 'restart' of 'authentication infrastructure' may be a rolling restart and perhaps they have not got to Germany yet, perhaps by using Google's DNS different 'authentication infrastructure' is being provided?
snitch182 8y ago
Moving to another Provider might involve shifting to other ips. Probably sucks to be working there right now.

maltalex 8y ago

Perhaps it's related to the DNS flag day [0] that's coming up on Friday? [0]: https://dnsflagday.net/ https://dnsflagday.net/

fanf2 8y ago
Certainly not, because it hasn’t happened yet
- chrismorgan 8y ago
  Not certainly not. Hypothetical scenario: realise something in your infrastructure will have problems in a few days’ time, and so make changes, which accidentally break things.
- Godel_unicode 8y ago
  You've never made a change in advance of an upcoming problem that accidentally broke something else? Lucky...

Bombthecat 8y ago

Ouch, level3 is pretty big. How could they have an outage?

tallanvor 8y ago
Level3 is not exactly known for being rock solid.

tinus_hn 8y ago

Why would Microsoft be using a third parties DNS? It’s trivial to host it yourself.