14 ms·
Looking at the Downdetector home page [1], it looks like many more services are having outages, not just the ones owned by Meta, including: - Google - YouTube
by DeusExMachina 3y ago
Looking at the Downdetector home page [1], it looks like many more services are having outages, not just the ones owned by Meta, including:
- Google
- YouTube
- Google Play
- T-Mobile
- X (Twitter)
- Discord
- TikTok
- Pokemon Go
- Snapchat
It looks like they all have the same failure point.
[1] https://downdetector.com https://downdetector.com
- andtheboat 3y agoiirc these all use GCP which would make sense for them all to be disrupted at the same time. I wouldn't have thought Meta was GCP reliant though?
- Yiin 3y agoall of them are using oauth, likely auth provider issue?
- bburnett44 3y agoThere’s no way fb uses gcp
- ajross 3y agoMost of those seem OK for me now, and DD agrees. This seems to have been a temporary blip for all of them, possibly some kind of service switchover/fallback "not entirely unrelated" to the Meta outage? Edit: actually a more attractive theory, given the very short timelines and near simultaneity of all those failures, is that downdetector itself had a failure, possibly a Meta-dependence, that they noticed and corrected quickly.
- peterleiser 3y agoGCP seems fine, and no issues logging into Google Cloud Console.
- peterleiser 3y agoS**'s gettin' real: https://downdetector.com/status/pokemon-go/ https://downdetector.com/status/pokemon-go/
- AndyJames 3y agoSome piece of core infrastructure went down because everyone got spike at the same time. Surprisingly DoorDash and Steam was up
- agilob 3y agoEverything is going down, except Steam. You know where to find me.
- dwighttk 3y agoScrolling down their list, why is DoorDash the only one that didn’t have a spike this morning?
- esnard 3y agoPokémon GO player here, the app was absolutely fine unless you tried to use Facebook as your login provider.
- tuan 3y agoFb is down but YT is still up for me.
- deleted 3y ago[deleted]
- jon-wood 3y agoOr people are using Facebook Auth for them. I don't really trust Down Detector, which despite the claims is really People Winging on Twitter Detector.
- redserk 3y agoYeah, it's wild that it's now treated as an authoritative source, especially by some news organizations. It's as good as asking a neighbor what happened with a loud noise down the street. Sometimes you'll get something good, sometimes it'll be completely wrong.
- paulddraper 3y agoIt's as good as asking a thousand neighbors if they heard anything down the street.
- colpabar 3y agoDowndetector is nice because it answers my question of "is anyone else having issues with this?" When it takes AWS an hour to even acknowledge "increased error rates", and tells me that everything is a-ok in the meantime, I want another perspective.
- ceejayoz 3y agoTwitter's search used to be my go-to for this - a search for "AWS down" would typically be very illuminating - but it's tough to get it to genuinely spit out the most recent tweets with a keyword these days.
- AceyMan 3y agoThe New York Times just posted a news flash ... citing Down Detector :-P
- rimunroe 3y ago> Yeah, it's wild that it's now treated as an authoritative source, especially by some news organizations. > It's as good as asking a neighbor what happened with a loud noise down the street. Sometimes you'll get something good, sometimes it'll be completely wrong. Asking my neighbors if they know what some loud noise was or about some local disturbance has been extremely reliable in my experience. The one time someone gave me an explanation about something which wasn't mostly right they qualified it with something like "So-and-so said it might be such-and-such but I don't know if it's true".
- harryquach 3y agoThanks for sharing this, from what I have read it looks like an issue beyond just Facebook.
- sbrother 3y agoHN seems to be struggling too, but that could just be everyone here to talk about the outages.
- passwordoops 3y agoHappens whenever Sama sneezes too
- GaggiX 3y agoThat's the standard HN experience, this site runs on a single core I believe.
- HumblyTossed 3y agoDoes it really or is this a joke? Edit: I found the following, I wonder if it's still the case. https://news.ycombinator.com/item?id=16076041 https://news.ycombinator.com/item?id=16076041
- neocritter 3y agoIt's real. Single core performance improves all the time. People overestimate how much power it takes to handle lots of queries per second on a well-tuned system and well-written software in 2024. https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=single-core%20by%3Adang&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
- deleted 3y ago[deleted]
- __s 3y agoNote that's the application server process being single threaded, but the server machine is 4 core, so nginx cache etc use other cores
- 3y ago
- govg 3y agoThere is no consistent scale on that graph, so any local maxima of reports received would look similar to any other.
- mankyd 3y agoExactly this. FB topped out around 520,000 reports. Google topped out around 1,400. That's a massive difference in scale. Both are above their baselines, but I bet some is just mis-reports, or increases in awareness due to more people checking in. Meta seems to be the only one really affected from what I can tell.
- jordanthoms 3y agoWe saw a big spike in latency and failures on the Google OAuth apis starting at the same time (15:21 UTC)
- NelsonMinar 3y agoI made that same mistake after seeing someone post an unlabeled set of graphs to a Slack. The Google peak reported outages is about 0.25% of the Facebook peak. It seems reasonable some people just made a mistake.
- btbuildem 3y agoWhat's your fave conspiracy theory? Massive cyberattack for Super Tuesday? Powers-that-be mandated takedown? Mossad sleeper agents activated? Covid-brain struck that one engineer attending to that one wire that kept everything going?
- eddof13 3y agoGoogle was acting up for me as well, so that could be
- jedberg 3y agoMan the postmortem on this is gonna be fun. “Yeah so it turns out when Facebook and Instagram goes down so does Google” I do not envy the SREs at either company. I'm pretty sure all those other ones use Facebook or Google as their OAuth provider which is why they are all being reported as down.
- MandieD 3y agoAdditional fun factor: today is Super Tuesday - primary elections in a lot of US states. This outage will result in absolutely no ridiculous conspiracy theories.
- kurthr 3y agoIf your election integrity relies on Facebook, YouTube, or even DNS to be up... there are bigger issues. Actually, if all of them including Xitter went down, maybe things would get better? All the sunlight photons might get sucked in by too many eyeballs though, and there could be grass trampling.
- Turing_Machine 3y ago> If your election integrity relies on Facebook, YouTube, or even DNS to be up... there are bigger issues. I agree. While I don't think it likely that Facebook or YouTube would enter into it, I'd pretty much bet that DNS being down would cause problems. And yes, there are bigger issues with that. Much.
- chakintosh 3y agoCloudflare or AWS ?
- nickpsecurity 3y agoA lot of sites have features that say “log in with your X or Y account.” They connect to each other somehow. I never studied that protocol. I wonder if authentication failures across services could be tied to it. For process of elimination, do all of these services do multi-platform logins? Or do some not connect to anyone else?
- dylan604 3y agothat actually infuriates me more than cookie banners. the one from Googs is the worst offender.
- tdudhhu 3y agoServices are coming back to live. Interesting to see that all static content was still working during the outage (at least for Instagram). It was still possible to swipe through all reels (I assume the list was cached).
- yosito 3y agoI think the content was probably cached on your device.
- partiallypro 3y agoDown Detector is so unreliable. People that can't call an AT&T phone via Verizon will think (and report) that Verizon is down, when it's really AT&T. People can try logging in using Facebook's on click login and not be able to get in, so they think Tiktok is down. It's not all that useful. I hate when journalists cite it.
- dylan604 3y agoIt's only slightly better than "my mom claims". My mom would ask if I had the internet at my house. Yup. all of it. in a rack in my bedroom closet. She'd also report the "internet is down" when a single website was having issues. To me, that is down detector carrying on the legacy of moms everywhere.
- jordanthoms 3y agoA single report on there is useless. A sudden flood of reports is a good sign that something interesting is happening.
- ambichook 3y agoand something is usually happening. the issue is that a lot of end users (so the people that down detector is pulling from) don't understand the systems well enough to point to where that something is and will often misattribute it, which is what both parent and grandparent is claiming.
- jordanthoms 3y agoIt has false positives and noise for sure, but it's also very sensitive and shows issues very quickly. I wouldn't trust it as a single source, but in a case like this where our internal monitoring shows a spike of issues with the Google APIs and we can see a huge spike in reported issues for Google on Downdetector starting at the same time, it's useful to confirm that the issues have an external source.
- pixl97 3y agoEh, mostly it's people misunderstanding what it represents. If I can't login to tiktok because FB is down, then tiktok is effectively down for me. When it comes to technology most people don't care about the trip, they care about the destination. So yea, tiktok isn't "down" but for a lot of people it might as well be, hence coupling your infrastructure/auth on other providers has side effects like this you must take into account.
- deleted 3y ago[deleted]
- tonymet 3y agoFacebook audience is in the billions, so you will see 100k false positives when a big site like that goes down.
- callalex 3y agoDowndetector has successfully detected 150 of the last 20 outages. Its mention should honestly be banned from this site.
- dzlobin 3y agoThis is just a knock-on affect from 1B+ users moving their timespent elsewhere during the outage
- blastadon 3y agoYeah, I had issues accessing GCP's documentation site for AlloyDB around 8:00-9:00ish Eastern this morning. The page just said 'Service Unavailable'. Had to use Google Cache.
- Vicinity9635 3y agoX (Twitter) wasn't affected: https://twitter.com/elonmusk/status/1765048551023734801 https://twitter.com/elonmusk/status/1765048551023734801 Downdetector is user reports, not automated monitoring. It's... semi-trustworthy.
- chimeracoder 3y agoIn general, linking to an Elon Musk tweet is hardly proof that a Twitter service degradation didn't happen. Even more so when the tweet in question isn't even a direct claim about Twitter, but just a meme making fun of a competitor.
- Vicinity9635 3y agoThe fact that twitter was usuable the whole time does.
- chimeracoder 3y ago> The fact that twitter was usuable the whole time does. That's an assertion, not a substantiation. A single tweet does not corroborate that, even if you ignore the fact that most outages of large global services (including some of the outages of these Facebook properties mentioned above) are actually partial degradations.
- Vicinity9635 3y ago[dead]
- TuringNYC 3y agoAll the electronic candy/soda vending machines in our office are also not working. Shudder to think of the chain of dependencies inside these machines.
- adawg4 3y agoIs downdetector known for accuracy in these types of situations? Seems like a large amount of services out.