6 ms·
Google's Down
Looks like a huge # of Google Services are down including GCP. Some services that appear to be impacted - Gmail, YouTube, and Cloud Firestore.
https://downdetector.com/status/google/
- murillians 7y agoSearch or another google service? G Suite is reporting some issues, but i'm connecting to search fine https://twitter.com/gsuite/status/1243203000195256320 https://twitter.com/gsuite/status/1243203000195256320
- heartbreak 7y agoI can't connect to search. I get a 500 error page.
- sevenf0ur 7y agoWe're a gsuite customer and just noticed some interruptions here as well. GMail is flaky, chat is down, and the app status page is unavailable as well. https://www.google.com/appsstatus https://www.google.com/appsstatus Not very useful :P
- judge2020 7y agoDiscord as well, looks like it's hitting GCP https://twitter.com/hopeseekr/status/1243201607854108673?s=21 https://twitter.com/hopeseekr/status/1243201607854108673?s=2...
- larrik 7y agoI got a 503 from Google Classroom, but it seems intermittent.
- sumoboy 7y agoGoogle ads is insanely slow.
- sixhobbits 7y agoHaven't noticed issues here in Switzerland
- mercurial 7y agoWorks fine here (Denmark)
- pilom 7y agoLooks like issues are primarily on the east coast: https://downdetector.com/status/google/map/ https://downdetector.com/status/google/map/ No issues with any google services thus far for me in Denver.
- husamia 7y agoNot only east coast, it looks global.
- albertzeyer 7y agoNo, it does not. No problems at all here (Germany).
- jve 7y agoMe from Europe. Youtube has been open for last ~20mins and is UP.
- jldugger 7y agoHard to say. US populations are eastern centralized; west coast is only now getting to work, checking their mail, and searching bing for why google is down. You'd need a population + timezone forecast of that map to really measure regional outages.
- tinix 7y agoDenver here, I got a few 500 errors earlier this morning on search.
- jedberg 7y agoI think that graph is biased towards the fact that the east coast is awake while the west coast is not. Also almost 50% of the US population lives in a state that touches the Atlantic. It was down for me here in California.
- dillondoyle 7y agoIm in Denver too. consumer products are up. Cloud: we have large appEngine (2000 req/s at peak - it's <i>very</i> up and down spiking), functions, and heavy pubsub/biquery. Didn't notice any downtime or large errors. Last time there was cloud downtime Google wouldn't give any credit because it was still under the SLA. Though we're really small fish a tiny gesture of good will would have felt nice.
- FactolSarin 7y agoHangouts seems to be down altogether
- ghastmaster 7y agoGmail down, search working, youtube working in Cincinnati ohio.
- bithavoc 7y agoMeanwhile their status page[0] is all green. The less they publish on their status page the more nines they preserve. [0] https://status.cloud.google.com/ https://status.cloud.google.com/ Edit: status page not entirely green now, took them 25 minutes to acknowledge.
- supdatecron 7y agoThey added "We are experiencing an issue with Google Cloud infrastructure components" at the top, but everything is still green. Are they unaware of which components have issues?
- bradfitz 7y agoThey know internally from the real status dashboards & real monitoring. I think the issue is that this status page is maintained by hand, by humans, and updating it likely requires lots of communication and sign-off approvals, and trying to get numbers to decide whether an outage is big or only impacting a tiny fraction of users. Otherwise it'd probably always be red.
- ricardobeat 7y agoIt has a 'We are experiencing an issue with Google Cloud infrastructure components.' notice at the top though. Gmail / GSuite / Youtube are not directly listed, though Firestore is and it's still green.
- discreditable 7y agoG Suite Status is all green with no warnings. https://www.google.com/appsstatus https://www.google.com/appsstatus
- jvolkman 7y agoThere are many warnings now.
- discreditable 7y ago
- rafaelgarrido 7y agoWho searched "google" on google.com ??
- PopeDotNinja 7y agoraises hand
- js2 7y agoTerri Gross: Now I'll tell you, in preparing for this, I decided, let me Google Google, so I typed in "Google" into the Google search, and I came up with a lot of Google things in the regular search, but in the "Are you feeling lucky?" search, I got nothing. Larry Page: Well you just got Google itself. TG: Yeah, I just got Google itself. Oh, I see, Google was giving me itself. LP: Yeah. TG: Oh. LP: In computer science, we call that recursion. [laugh]. TG: Oh, you even have a name for it. [laugh]. I didn't quite get that. I kept thinking it was just repeating itself. I didn't realize it was giving me itself. [laugh]. LP: [laugh] TG: And what's the name for it? LP: Uh, recursion. It's... kind of... Sergey is giving me a dirty look. TG: Why? LP: It's a loose definition. [laugh] TG: Lighten up Sergey. [laugh] LP: It's a loose interpretation of... [laugh]... recursion. TG: Sergey, what's the more literal interpretation? ... Starts at 13:45: https://www.npr.org/2003/10/14/167643282/google-founders-larry-page-and-sergey-brin-part-2 https://www.npr.org/2003/10/14/167643282/google-founders-lar...
- dumbfounder 7y agohttps://pasteboard.co/J0TXBAW.png https://pasteboard.co/J0TXBAW.png
- cdubzzz 7y agohttps://www.youtube.com/watch?v=qdjRwpYM-Kw https://www.youtube.com/watch?v=qdjRwpYM-Kw
- DonHopkins 7y agoWho targets ads at searches for "google" on google.com? People who do that are a highly sought after demographic.
- MasonBario 7y agoHaven't noticed :/
- sarathyweb 7y agoSearch is working fine in India.
- timvisee 7y agoIt seems to be pulling a LOT with it. Even services like Microsoft Office 356
- Aaronstotle 7y agoG-suite has been intermittent for me this morning.
- bob33212 7y agoBack up for me. I have Google fiber as well
- geephroh 7y agoBeen able to log into Analytics web dashboard, but get "try again later" errors for all our properties. Been that way since about 8am PDT here in Seattle.
- perlpimp 7y agoworks fine in Toronto, Canada
- jeffrogers 7y agoGoogle Classroom getting 504s on the west coast
- cpach 7y agoSo far Gmail and Youtube works fine here (Stockholm area, Sweden)
- bwb 7y agoSpain went down for 5 min while i was in a google doc + analytics. I run downforeveryoneorjustme.com and we went up to 1000 people a minute checking too. It only lasted a few min though.
- jedberg 7y agoI just want to say thank you for your website. It’s saved my sanity many times. I’m curious, what’s your tech stack? Your site always seems to be up when everyone else is down. :)
- bwb 7y agoThanks :) My friend spent the last year rewriting it! She is amazing! We went from Ruby on Rails, AWS, and a $800+ a month server bill to paying almost nothing to run it (and with better checking). We are working on launching a blog for it and she is going to write up a full breakdown of the project. I'll post it to Show HN then. This is a write up that covers it a bit from how we got featured on CloudFlare last week: " As for how we're using Cloudflare workers... The actual frontend website is a fairly tiny Nuxt/VueJS app and that operates in AWS Lambda right now, but we have about an 80% cache rate normally, so Cloudflare is serving most of that anyway. It's on AWS primarily because we have credits with them, plus that is where I started working on it and I had used Lambda in previous projects. At the time we relaunched it early last year, Cloudflare workers was still in beta and not as refined as it is now, especially now that it has better CLI tooling. The only reason the site itself doesn't live in Workers is because deploying JS apps was a bit...rough last year due to lack of tooling but it looks like that has improved significantly and I will probably eventually move the frontend site, too. The backend portion of the site that checks if a site is down is just a simple HTTP API, which also was first written for Lambda/Node, but I later rewrote it in Cloudflare Workers primarily because I liked that it executed the worker in the edge closest to the visitor automatically, instead of us having to deploy our app in numerous AWS regions. It's a perfect use case for how our site works. The other way we use Workers is in conjunction with the key/val store service you have. Our site gets a lot of attacks and I made a rate-limiting system that will rate limit and then automatically block abusers that do not relent in the cloudflare firewall via your API. It uses ELK + Elastalert to accomplish that, which gives us a bit more control over how and when we want to rate limit / block than the one in built-in to Cloudflare. I struggled a bit getting these under control with AWS (even with their WAF) and had a fairly frequent events that paged me requiring manual intervention, but now I barely ever get paged for issues on the site, it's been 100% uptime for months. I'm a huge proponent of serverless if the project fit is right and I've definitely enjoyed working with Cloudflare a lot more than Lambda. "
- 6gvONxR4sf7o 7y agoCan we get a title change? "Google's Down" tells me something totally different.
- bsilvereagle 7y agoOn this note, a public postmortem from the 16 Oct 2018 YouTube outage does not seem to exist. If enterprise customers are impacted, there will likely be a public postmortem for this incident, but it is still publicly unknown what caused YouTube to go down.
- superbm 7y agoNow you see that it's not only Microsoft problem...
- nathanaldensr 7y agoDiscord was down for several minutes earlier, as well. Related?
- randomifcpfan 7y agoAuthoritative explanation Very sorry about that! We had a router failure in Atlanta, which affected traffic routed through that region. Things should be back to normal now. Just to make sure: this wasn't related to traffic levels or any kind of overload, our network is not stressed by Covid-19. https://twitter.com/uhoelzle/status/1243217659690278912 https://twitter.com/uhoelzle/status/1243217659690278912
- Kialo 7y agoThank you. Upvote this!
- jvolkman 7y agoFor posterity, the final status update: The issue with Google Cloud infrastructure components has been resolved for all affected users as of 09:21. Total time of impact was 08:18 to 09:21 US/Pacific, with the most severe impact at the start of the issue, tapering off as services routed traffic away from Atlanta. The impact of this incident was concentrated in a region that is not a main GCP region and therefore there was no impact to services based on Google Compute Engine. Services that may have been impacted include External HTTP/S Load balancing requests and API requests that may have been served near the Atlanta metro. The root cause was a set of router failures in Atlanta, which affected traffic routed through that region.