3 ms·

It's not only Facebook, a lot of services, Deezer, some operators in France... https://downdetector.fr/ https://downdetector.fr/

avh02 6y ago
i'm not necessarily familiar with all the services (or the specific dependencies) on that list, but a lot of it will be a knock on effect from e.g: fb login not working as expected People will very often see it as "service x with fb login is broken"
- florianmari 6y ago
  I work in one of these companies and I can confirm that is a network outage and even our internal tools hosted in our datacenter (so no dependencies with fb) are down
  - avh02 6y ago
    I stand corrected :) Any info on what network/operator/operator/etc is suffering the issue? (just so people know about it if it's public, i don't see anything on HN at least) Thanks, and good luck!
  - walrus01 6y ago
    I sincerely hope that AS3356 hasn't broken a big chunk of the Internet again. https://isc.sans.edu/forums/diary/CenturyLink+Outage+Causing+Internet+Wide+Problems/26518/ https://isc.sans.edu/forums/diary/CenturyLink+Outage+Causing... https://www.zdnet.com/article/centurylink-outage-led-to-a-3-5-drop-in-global-web-traffic/ https://www.zdnet.com/article/centurylink-outage-led-to-a-3-...
    - dahfizz 6y ago
      My bet is BGP. Its always BGP.
      - walrus01 6y ago
        Every time this happens I have a mental metaphorical image of somebody tripping over the $5 power strip that has the single point of failure route-server or route-reflector plugged into it.
      - oblio 6y ago
        It's been a while since I studied routing, but have they fixed BGP security? I remember reading about the protocol and thinking something like: this seems awfully "hippie-trust" levels of security. Granted, this was 10 years ago so my recollection of BGP is super fuzzy :-D
        walrus01 6y ago
        nope. proper and full implementation of BCP38, MANRS, full RPKI validation of all IP ranges and such is a long distance away. within trusted groups of ISPs where the admins all know each other, in certain specific geographic regions, it's better than others.. I would say that the number of ISPs I could call "fully compliant" with current best practices, in the Portland-Seattle-Vancouver area, is higher than in many other parts of the world.
        curi0sity 6y ago
        As someone interested in the internal workings of the internet, do you have any further reading on current best practices?
        walrus01 6y ago
        ARIN, RIPE and APNIC publish a great deal of useful documentation on how to set up BGP stuff properly in the modern era. And information for how to fully implement dual stack with ipv6. As for other current best practices there's really a very great variety of disciplines involved in ISP operations, depending on what type of ISP it is. What's relevant for a GPON FTTH last mile provider might not be as relevant for a colocation/dedicated server ISP. Or for a WISP. My recommendation on that would be to pick the subject to research and make inquiries in the special interest groups dedicated to that (for instance, two way satellite, or automated billing/provisioning systems for hosting companies, or CRM systems, or whatever).
bilekas 6y ago
OVH Also having a lot of trouble today .. http://weathermap.ovh.net/ http://weathermap.ovh.net/ Its a large hosting provider in EU at least.. Not sure the knock on effect.
chewz 6y ago
Solar flare - Solar Cycle 25 is here https://news.ucar.edu/132771/new-sunspot-cycle-could-be-one-strongest-record https://news.ucar.edu/132771/new-sunspot-cycle-could-be-one-... https://www.nasa.gov/press-release/solar-cycle-25-is-here-nasa-noaa-scientists-explain-what-that-means/ https://www.nasa.gov/press-release/solar-cycle-25-is-here-na... The sun is awakening with ‘solar storms’ that could affect Earth - https://www.washingtonpost.com/weather/2020/12/08/solar-storms-sunspots-aurora/ https://www.washingtonpost.com/weather/2020/12/08/solar-stor... A Powerful Solar Flare Produces Bright Northern Lights This Week - https://www.forbes.com/sites/ericmack/2020/12/09/a-powerful-solar-flare-brings-bright-aurora-and-disruptions-to-earth-this-week/ https://www.forbes.com/sites/ericmack/2020/12/09/a-powerful-...
- driverdan 6y ago
  This has nothing to do with solar flares or cycles.
  - JMTQp8lwXL 6y ago
    Root Cause Analysis has determined that solar flares, which come from the Sun, are the reason any life exists on Earth. Without the sun, no technical evolution would have occurred and no outage in Facebook's infrastructure would have happened.
    - anonymou2 6y ago
      wow... Haven't you heard about the Big Bang?
      - vmception 6y ago
        is that sarcasm? because I can play, but only if we confirm this is sarcasm
        polynomial 6y ago
        There are technical limits to how much sarcasm can be understood as such on the Internet.
echlebek 6y ago
Yeah, I recently discovered while evaluating Deezer that it doesn't function without scripts from facebook. So, I didn't subscribe.

avh02 6y ago

i'm not necessarily familiar with all the services (or the specific dependencies) on that list, but a lot of it will be a knock on effect from e.g: fb login not working as expected People will very often see it as "service x with fb login is broken"

florianmari 6y ago
I work in one of these companies and I can confirm that is a network outage and even our internal tools hosted in our datacenter (so no dependencies with fb) are down
- avh02 6y ago
  I stand corrected :) Any info on what network/operator/operator/etc is suffering the issue? (just so people know about it if it's public, i don't see anything on HN at least) Thanks, and good luck!
- walrus01 6y ago
  I sincerely hope that AS3356 hasn't broken a big chunk of the Internet again. https://isc.sans.edu/forums/diary/CenturyLink+Outage+Causing+Internet+Wide+Problems/26518/ https://isc.sans.edu/forums/diary/CenturyLink+Outage+Causing... https://www.zdnet.com/article/centurylink-outage-led-to-a-3-5-drop-in-global-web-traffic/ https://www.zdnet.com/article/centurylink-outage-led-to-a-3-...
  - dahfizz 6y ago
    My bet is BGP. Its always BGP.
    - walrus01 6y ago
      Every time this happens I have a mental metaphorical image of somebody tripping over the $5 power strip that has the single point of failure route-server or route-reflector plugged into it.
    - oblio 6y ago
      It's been a while since I studied routing, but have they fixed BGP security? I remember reading about the protocol and thinking something like: this seems awfully "hippie-trust" levels of security. Granted, this was 10 years ago so my recollection of BGP is super fuzzy :-D
      - walrus01 6y ago
        nope. proper and full implementation of BCP38, MANRS, full RPKI validation of all IP ranges and such is a long distance away. within trusted groups of ISPs where the admins all know each other, in certain specific geographic regions, it's better than others.. I would say that the number of ISPs I could call "fully compliant" with current best practices, in the Portland-Seattle-Vancouver area, is higher than in many other parts of the world.
        curi0sity 6y ago
        As someone interested in the internal workings of the internet, do you have any further reading on current best practices?
        walrus01 6y ago
        ARIN, RIPE and APNIC publish a great deal of useful documentation on how to set up BGP stuff properly in the modern era. And information for how to fully implement dual stack with ipv6. As for other current best practices there's really a very great variety of disciplines involved in ISP operations, depending on what type of ISP it is. What's relevant for a GPON FTTH last mile provider might not be as relevant for a colocation/dedicated server ISP. Or for a WISP. My recommendation on that would be to pick the subject to research and make inquiries in the special interest groups dedicated to that (for instance, two way satellite, or automated billing/provisioning systems for hosting companies, or CRM systems, or whatever).

bilekas 6y ago

OVH Also having a lot of trouble today .. http://weathermap.ovh.net/ http://weathermap.ovh.net/ Its a large hosting provider in EU at least.. Not sure the knock on effect.

chewz 6y ago

Solar flare - Solar Cycle 25 is here https://news.ucar.edu/132771/new-sunspot-cycle-could-be-one-strongest-record https://news.ucar.edu/132771/new-sunspot-cycle-could-be-one-... https://www.nasa.gov/press-release/solar-cycle-25-is-here-nasa-noaa-scientists-explain-what-that-means/ https://www.nasa.gov/press-release/solar-cycle-25-is-here-na... The sun is awakening with ‘solar storms’ that could affect Earth - https://www.washingtonpost.com/weather/2020/12/08/solar-storms-sunspots-aurora/ https://www.washingtonpost.com/weather/2020/12/08/solar-stor... A Powerful Solar Flare Produces Bright Northern Lights This Week - https://www.forbes.com/sites/ericmack/2020/12/09/a-powerful-solar-flare-brings-bright-aurora-and-disruptions-to-earth-this-week/ https://www.forbes.com/sites/ericmack/2020/12/09/a-powerful-...

driverdan 6y ago
This has nothing to do with solar flares or cycles.
- JMTQp8lwXL 6y ago
  Root Cause Analysis has determined that solar flares, which come from the Sun, are the reason any life exists on Earth. Without the sun, no technical evolution would have occurred and no outage in Facebook's infrastructure would have happened.
  - anonymou2 6y ago
    wow... Haven't you heard about the Big Bang?
    - vmception 6y ago
      is that sarcasm? because I can play, but only if we confirm this is sarcasm
      - polynomial 6y ago
        There are technical limits to how much sarcasm can be understood as such on the Internet.

echlebek 6y ago

Yeah, I recently discovered while evaluating Deezer that it doesn't function without scripts from facebook. So, I didn't subscribe.