27 ms·
Ask HN: Google Search down?
I am getting the following message when performing searches:
Server Error
We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue.
Please try again later.
- TheAceOfHearts 4y agoIt never went down for me in Puerto Rico, wonder if the downtime was regional. It'll be interesting to read a postmortem.
- smoe 4y agoIt was briefly down for me in Colombia. Seems quite a wide-ranging issue.
- rblatz 4y agoI was getting a lot of errors on google maps trying to pull up information about different restaurants.
- personthrow195 4y agoIt is interesting that this corresponded with the announcement of the FBI raiding Trump’s house.
- mullikine 4y agoSkynet
- satchlj 4y agoIt's back up for me
- satchlj 4y agoanyway, use searx! https://searx.space/ https://searx.space/
- bjd2385 4y agoWas just about to post this, I'm seeing issues.
- alfiedotwtf 4y agoHad a few 502s, but then 500s. ... but now it's back
- game-of-throws 4y agoI'd love to see Kagi's traffic stats right about now
- gunsch 4y agoYep. google.com homepage is giving me 502s. It's been a looooong time :-o edit: aaaand it's back
- deleted 4y ago[deleted]
- jameshe 4y agoNoticed it was down for about 2 minutes, but up again. As with any big outage, I wonder how much money was lost in those 2 minutes...
- russellbeattie 4y agoOK, so in round numbers, Google makes roughly $65 billion in profit per quarter. Dividing by 90, is around $722 million per day, which is roughly $200,000 per second. 2 minutes is quite the expensive fuckup.
- game-of-throws 4y agoI'd use revenue instead of profit, since their expenses don't disappear just because the site is down. If Google is walking down the street and stops to pick up a million dollar bill, it actually loses money.
- Aperocky 4y agoBut do they actually cough up 2 minutes worth of profit because they were down for 2 minutes?
- xhrpost 4y agoI think you're looking at revenue. Year end 2021 was $257,637M, divide by 4 = $64.4B per quarter. Net income was $76B or about $19B per quarter. https://abc.xyz/investor/static/pdf/2021Q4_alphabet_earnings_release.pdf?cache=d72fc76 https://abc.xyz/investor/static/pdf/2021Q4_alphabet_earnings...
- russellbeattie 4y agoI'm so confused. I honestly think we said the same thing. But I'll go with whatever. It wasn't really a serious point.
- quickthrower2 4y agoExpensive for you, but for Google it is nothing. A bug in their Ad placement stack would cost more.
- techdragon 4y agoIf we didn’t need more evidence of search quality sliding downhill. When was the last time this happened for enough people (failed ab tests don’t count) that it cropped up on HN and got several confirmations that it was happening to other people. Not a good look for Google.
- jwitthuhn 4y agoI am seeing failures on and off. If I keep resubmitting it will go through eventually.
- alhirzel 4y agosame
- donkeybeer 4y agoHappening on some queries right now, mainly some image searches it seems, good to know I am not the only one.
- sydney6 4y agoSearch suggestions appear to be also down for me..
- passive 4y agoIt's slow and I'm getting 500s sometime. Nova Scotia, Canada
- jhickok 4y agoSearch is currently not working most of the time for me.
- radious 4y agoHappening to me right now.
- bennathanson 4y agoFlaky for me.
- khaledh 4y agoIt's up again, but response is slower than usual.
- timack 4y agoI'm getting "Error 500" on Google URLs. Am in New Zealand.
- varenc 4y agoStill down for me. Sometimes getting this message: Server Error We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue. And then sometimes getting a more generic 500 message.
- kushan2020 4y ago500 in Toronto as well.
- bearjaws 4y agoSlow performance for me in Florida, with some requests failing entirely. Seems to impact Youtube maps and search.
- endisneigh 4y agopour one out for poor person oncall tonight.
- tevon 4y agoF
- scott_siskind 4y agoSame here. Have been trying to use search for the past 10 minutes, and 9 times out of 10, i'm getting error 500.
- y0ungarmanii 4y agoyahoo it is
- redcitylights 4y agohttps://downdetector.com/status/google/ https://downdetector.com/status/google/ Yes, intermittently.
- mmaunder 4y agoWas broken for me a few mins ago with 500 errors on various searches.
- markus_zhang 4y agoYes down for me (Quebec)
- archhn 4y agoIt is for me in Connecticut.
- gcoladon 4y agoDown for me on the Stanford campus
- indians3452 4y ago500 in North Carolina
- bigDinosaur 4y agoNot only down, but the error page isn't even https? Goodness me!
- che_shirecat 4y ago> googles "google status tracker" in chrome address bar oh.
- indians3452 4y ago500s in North Carolina
- brezelgoring 4y agoDown in Uruguay, getting a 500 response 100% of the time.
- nomy99 4y agodown in nyc :|
- delfinom 4y agoLooks like CenturyLink/Level3 is also down. Somebody typo a BGP route again?
- kixiQu 4y agoMaps down for me. 500, specifically with a response document titled "Error 500 (Server Error)!!1"....
- kbyatnal 4y ago"500. That’s an error" on all search queries
- prescriptivist 4y agoRandom 500s yeah.
- 28194608 4y agoI'm getting "Error 500" on Google URLs. Am in Japan.
- blackoil 4y agoGetting 500 also in India
- Kstarek 4y agoDown for me in NYC as well
- teacpde 4y agoMaps seem to be impacted as well.
- 01000010x 4y agoSame in Taiwan
- davgoldin 4y ago500 in Tokyo, Japan Nice page title: "Error 500 (Server Error)!!1"
- asadawadia 4y agothe guy forgot to press shift on the last 1 lol
- Strom 4y agoIt's a deliberate meme from early 2000s. https://knowyourmeme.com/memes/the-1-phenomenon https://knowyourmeme.com/memes/the-1-phenomenon
- throwaway742 4y agoGetting intermittent 502's.
- alphabet9000 4y agoscreenshot of error for me https://i.jollo.org/gOYYYtrW.png https://i.jollo.org/gOYYYtrW.png
- agotterer 4y agoI'm getting 500's on 50% of my searches for the past 2-3 min from New York.
- Kstarek 4y agoIt's back up for me now in NYC
- ian_dot_so 4y agoDown in NYC
- pjot 4y ago500 error Server Error We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue. Please try again later.
- vehemenz 4y agoA little slow, but it's working for me.
- pooper 4y agoI searched https://www.google.com/search?q=is+google.com+down https://www.google.com/search?q=is+google.com+down And I got answer No. I have no idea what it would quote to give this snippet answer...
- collegeburner 4y ago"Your honor, I have investigated myself and found myself innocent."
- cornel_io 4y agoIf you're able to get the answer, it's correct, so no need to quote anything. Could be a hard-coded loc key.
- game-of-throws 4y agoKagi is still working!
- Tyrubias 4y agoSeems like it’s down for me too in NYC
- jpau 4y agoI was seeing 500s, but it seems back for me now (Melbourne, Australia)
- choletentent 4y agoSame in Brazil and Canada.
- gameshot911 4y agoJust came back...but it was definitely down for a bit!
- deleted 4y ago[deleted]
- memorable 4y agoNo problem at here. I'm in Vietnam
- ProAm 4y agoIt's up for me, but asked me to verify on my phone first that I was not a robot.
- abuggia 4y agoFront page was loading but queries returned 500s. Now front page won't load.
- wingworks 4y agoI was getting "Server Error" errors, but now 500 errors.
- deleted 4y ago[deleted]
- lukevp 4y agoGot an error in Portland, Oregon 31 minutes ago, so it's been going on / intermittent for a while.
- belltaco 4y agoThe error page is plain http, doesn't HSTS stop that?
- Unjg4gByHdjnyvp 4y agoGoogle doesn't have HSTS (on google.com).
- ocdtrekkie 4y agoThe irony. Google understands that HSTS negatively impacts availability massively, and shouldn't be used for production websites, but recommends it to others.
- Dylan16807 4y agoI don't care about the "availability" of an HTTP 500 page that much, to be honest.
- vanchor3 4y agoDon't forget enforcing it on certain TLDs, even for internal DNS records used for testing.
- ocdtrekkie 4y agoYes, but also I put a lot of the blame for this on ICANN's greed. They could've and should've refused to issue .dev, if they were doing a good and responsible job stewarding the domain space.
- josephcsible 4y agoBut HSTS absolutely should be used for production websites.
- ocdtrekkie 4y agoIt really shouldn't. HSTS is a harmful specification which both robs user agency and prohibits good service uptime. In 100% of all cases HSTS is in play, it's pretty much a cert that expired yesterday (aka, not actually a security risk). In exchange for this problem, HSTS demands that browsers stop acting as user agents and refuse to operate, no matter what the user says. It allows the server to dictate what the browser is supposed to do, without any bypass. Finally, the number one person who ends up wasting a lot of time trying to bypass HSTS: The dude trying to fix the certificate. A hilarious number of poorly-considered services have admins administrate the certificate from the web interface... which it won't allow the admin to access because of HSTS. This ends up exacerbating a simple problem into a complex one, and adds significantly to downtime. HSTS should be considered hostile and not recommended until amended with the removal of the "no user agency" clause. Honestly, a real world practical improvement for the entire HTTPS stack would be a more gentle expiration curve (browsers loading sites with expired certs for a week or so with a yellow address bar or something seems like a good idea, it's not like sites publish their private keys the day a cert expires). Unfortunately, the authors of HSTS did not consider the real world when developing their spec, they considered a virtually non-existent security case they wanted to address, and built a solution to an imaginary problem with significant real world negative impact.
- klintcho 4y agoBay Area getting server errors as well, some kind of attack?
- 7483804111 4y ago502 in Berlin.
- greenie_beans 4y agoThere's a typo in the page's title: `Error 500 (Server Error)!!1`
- tswiszcz 4y agoProbably intentional as a joke
- Dylan16807 4y agoIf you mean the punctuation, that is not a typo.
- Thorrez 4y agoThe !!1 is on 404 pages too: https://google.com/foo https://google.com/foo
- gilbetron 4y agoLast time google search was down I just switched to my back up, askjeeves. I'll give that a shot.
- nkozyra 4y agoTragically they took Jeeves out to pasture.
- tenebrisalietum 4y agoA true tragedy, for that pasture.
- deleted 4y ago[deleted]
- tireonfire 4y agoSeems to have recovered as of 8:44 CDT
- mrcartmeneses 4y agoNo problems for me in Thailand
- erklik 4y agoDown in Sydney. Intermittent errors when searching. How am I supposed to work? Also, I don't remember when Google Search was last down. Either google has great uptime, or I have terrible memory.
- zorpner 4y ago> How am I supposed to work? Whatever happened to the man pages, y'know.
- jeffbee 4y agoAm I the only person who primarily reads man pages on the web?
- nigelgutzmann 4y agoMy memory suffers more outages than Google Search for sure!
- pca006132 4y agoTry Duckduckgo? Indeed, I don't remember when Google search was down last time either.
- matheweis 4y agoDDG is mostly (but not all) Bing (context, yegg is the founder of DDG): https://news.ycombinator.com/item?id=31492631 https://news.ycombinator.com/item?id=31492631 https://news.ycombinator.com/item?id=31490994 https://news.ycombinator.com/item?id=31490994
- strken 4y agoIt's annoying that their link hijacker is also giving 500s.
- rtyz 4y agoFFS had to use Bing for a moment.
- 725686 4y agoGoogle maps down in Mexico City
- astan 4y agoAlso in San Francisco
- z3t4 4y agoSearch has been discontinued. Those still using Google search are recommended to use Youtube i stead.
- pelagicAustral 4y agoOr sneed instead
- vimwizard 4y agochuck
- collegeburner 4y agono google obviously can't sneed smh
- collegeburner 4y agoyou vill vatch ze shorts and you vill like it
- HHC-Hunter 4y agoOk Mr Schwab
- bushbaba 4y agoYou mean the #2 search engine ;P
- calvano915 4y agoI had an issue earlier today where an email forwarded to a Gmail address was not available to the recipient for an hour later. The delivery time was correct in message header but the message was delayed in displaying on their end.
- swethmandava 4y ago
- cellis 4y agoIntermittent in Oakland, CA
- propogandist 4y agohttps://search.brave.com https://search.brave.com is working fine
- yomkippur 4y agostop. spamming. brave.
- propogandist 4y agoan alternative search engine to replace the service that's down? ... you seem awfully mad to be policing the comments. It's possible to use a non-datamining search engine while being completely bearish on crypto too. Google needs more downtime.
- rvz 4y agoGood. We need actual working alternatives and right now Brave seems to be working today as the tech bros here are crying and getting upset about Google going down. > It's possible to use a non-datamining search engine while being completely bearish on crypto too. Indeed it is. Brave leads this example. Mozilla on the other hand is in Google’s payroll, paid to shill their privacy violating search engine.
- pelagicAustral 4y agoAmazing, it was down for me for about 10 minutes. Never seen this before.
- swethmandava 4y ago
- djsavvy 4y agoGonna use this as a chance to pub https://search.brave.com https://search.brave.com I switched to this from DuckDuckGo several months ago because Brave uses their own index, while DDG famously uses Bing's. The results are a lot better in my experience and it feels like the search engine is built for me instead of for advertisers. Brave search just feels like cleaner, quieter tech. I've also never seen NSFW results on an innocuous search (a problem I had regularly with DDG). On the rare occasion I end up using Google, seeing the results page is a jarring (and slightly stressful) experience with all of the distractions and irrelevant results.
- yomkippur 4y ago
- Unjg4gByHdjnyvp 4y agoYup, tons of 500 and 502. Very intermittent though, refresh mostly works.
- sydney6 4y agoNo Worries! The Google Server in Mountain View has had a disk failed in it's RAID and therefore the sqlite-DB has only half the iops to it's disposal. A new 500GB hard disk is already in dispatch with Amazon. These are the moments why Google is a proud Amazon Prime customer.
- Aperocky 4y agoSometimes you read something so ridiculous that it feels true.
- sydney6 4y agoBut i have to say: Personally, i don't run k8s and it's ecosystem and am just entering the whole "declarative world" with NixOS.. but nonetheless, these occasions are very rare, Google/YT Operations is just so impressive and has to be up there, if not a the very top.
- donkeybeer 4y agoHe's probably more referring to the amazon prime thing.
- simondotau 4y agoI know many people’s immediate reaction is that 500GB seems small, but remember, they’re not storing the whole internet — just an index of it. The whole internet would need a much larger RAID, with literally dozens of hard disks.
- etskinner 4y agoThey kind of do store the internet though, don't they? They store a cached version of most pages.
- nexuist 4y agoTbh the source code of the whole internet would probably be a few PB at most, text is really cheap to store especially because it can be compressed. Images and videos are what makes the premise impossible because even with perfect compression you need an impossible amount of storage to store every video published by mankind.
- sergiomattei 4y agoMaps wasn’t working. Got lost in Seattle.
- iou 4y agoPlace those bets, was it BGP? My money is always on BGP somehow.
- mmaunder 4y agoBGP problems will usually manifest as something being unreachable. This seems to be 500 errors which suggest code breaking somewhere.
- assttoasstmgr 4y agoI was getting mostly 502's indicating their reverse proxies couldn't reach the back end so it's very possible an internal routing issue was at fault.
- throwdbaaway 4y agoMisconfiguration at GFE control plane?
- inferiorhuman 4y agoWonder if it had anything to do with char broiling a few of their electricians this morning.
- mmaunder 4y agoSay what??
- lamontcg 4y agohttps://www.msn.com/en-us/news/us/three-people-in-critical-condition-after-google-data-center-electrical-incident/ar-AA10sb68 https://www.msn.com/en-us/news/us/three-people-in-critical-c...
- jimmygrapes 4y agoProbably referring to this: https://www.msn.com/en-us/news/us/three-people-in-critical-condition-after-google-data-center-electrical-incident/ar-AA10sb68 https://www.msn.com/en-us/news/us/three-people-in-critical-c... (sorry for msn link, archiving on phone is rough)
- philip1209 4y agoLet's see - was it DNS or BGP?
- Titan2189 4y agoIt’s not DNS There is a no way it’s DNS It was DNS
- yablak 4y agoThis is what happens when you raid Mar-a-Lago.
- ixtli 4y agoYou joke but there are definitely going to be people making this connection for real.
- WebbWeaver 4y agoLiterally how? maybe also triggered by this? /s https://www.rawstory.com/donald-trump-generals/ https://www.rawstory.com/donald-trump-generals/
- deleted 4y ago[deleted]
- bergenty 4y agoI’ll take Google being down for a whole day if we get more rewards like that.
- ontouchstart 4y agoWikipedia is fast https://en.m.wikipedia.org/wiki/Google_services_outages https://en.m.wikipedia.org/wiki/Google_services_outages https://en.m.wikipedia.org/wiki/Special:MobileDiff/1103262029 https://en.m.wikipedia.org/wiki/Special:MobileDiff/110326202...
- FirstLvR 4y agoyeah am blaffed how good wikipedia is covering current events
- dylan604 4y agoHow many 3rd party websites are available to corroborate these new edits?
- antupis 4y agoAnd how reliable Google services are that you can have that kind article.
- cowmoo728 4y agoOne time I was sitting in the New York metropolitan opera and heard Javier Camarena give an encore performance, which is quite rare. Immediately after the encore, it went to intermission. Once I walked out to the lobby, I checked his Wikipedia article on my phone and it had already been updated to note that he had just done an encore performance at the Met. It was insane how fast it was.
- prox 4y agoSo likely an editor was in the room?
- stackbutterflow 4y agoOr the singer himself or one of his agent did it.
- marginalia_nu 4y agoGoogle clearly saw my search engine's week-long outage as I reconstructed the index and felt confused and intimidated by the revelation that 89.9999% also is five nines.
- toast0 4y agoEverybody wants nine nines, but you achieved eight eights, which is pretty close? :)
- gzer0 4y agohttps://www.cnn.com/2009/TECH/06/26/michael.jackson.internet/ https://www.cnn.com/2009/TECH/06/26/michael.jackson.internet... This reminds me of the distant past. The death of Michael Jackson resulted in (almost literally) the entire internet suffering an outage.
- habibur 4y agoMore than that on 9/11. Every news site, online forum any online resource for news you can think of was unaccessible for hours. TV turned out to be the only news source.
- hedora 4y agoCell / landlines were dicey too.
- wbl 4y agoTV had two channels in NJ: a lot of stations liked the towers and it took them a few days to rig up alternates.
- soraminazuki 4y agoThe difference in internet adoption rate between those two time periods likely plays a key role in that.
- bobthepanda 4y agoTelephony (landline and cell) was also down due to extreme volumes. I don't know that in an event like that today we would do significantly better. Literally the entire country stopped for this to try and find info, because the event was just so extreme; the stoppage of all international flights and grounding them in Canada and Mexico with no notice was a side note, when that's literally never happened before. And, as with most major disasters of this type, the main issue was not physical damage but lack of electrical power to operate data centers and other infrastructure. A good chunk of transatlantic traffic runs through New York. That IMO is probably a major thing that I don't know we can handle.
- quickthrower2 4y agoFine from Sydney, NSW, Australia
- layoric 4y agoDoes your autocomplete/history come up? Mine is still 502ing
- quickthrower2 4y agoNow not fine! 500 on submission. 502 on autocomplete.
- keepquestioning 4y ago
- giantrobot 4y agoAny bets on whether it turns out to be BGP or DNS? I'll guess DNS, it's always DNS.
- tevon 4y agoWrong error for DNS I think. I'm getting 500s, not an unknown host error or similar. Routing server config? Interesting that its intermittent, I wonder if that tells us something about the internal routing of requests.
- fortran77 4y agoThey need to rewrite their software in Rust!
- ffhhj 4y agoWill Dang keep up with the flood of google-down threads?
- stevespang 4y ago
- psi75 4y agoI'm in Asia right now and it's been bad since last night (~07:00 California time). Gmail too.
- samstave 4y agoYAY?
- Alex3917 4y agoMaybe something to do with the new Gmail redesign that seems to have rolled out today? Or at least I just got it today, despite the fact that it was ostensibly released a month ago.
- dilawar 4y agoGetting 500 in Bangalore. Refresh like mad and it work half the time.
- breput 4y agohttps://www.sfgate.com/news/article/google-electrical-incident-injures-3-17360321.php https://www.sfgate.com/news/article/google-electrical-incide... Three people in critical condition after Google data center 'electrical incident' in the Council Bluffs, Iowa datacenter (us-central region, I believe)
- utopcell 4y agonot at all relevant to this outage
- dgrin91 4y agoSeems unrelated. This happened ~10 hours ago.
- prescriptivist 4y ago10 hours ago we had a flood of network failures in us-central1 and saw no GCP status changes. We blindly attempted to mitigate in various ways (freezing HPAs because we thought that we were making excessive calls to external infra and getting throttled) and it resolved itself eventually. Maybe we were at fault the entire time but not seeing this issue exposed up on the GCP dashboard is infuriating.
- zxcvbn4038 4y agoAt AWS, if the status changes then someone somewhere gets fired, so a lot of time incidents happen without being recorded on the status board. Maybe it’s the same issue with GCP, or maybe concern for their injured peers made everyone forget to update the status. I really hope the later.
- savant_penguin 4y agoHi guise this is my first push to prod, hope you guys like it
- wly_cdgr 4y ago
- encoderer 4y agoAt Cronitor we use google.com as one of our live tests of our uptime monitoring functionality and we saw intermittent downtime from 6:35-7:03
- smrtinsert 4y agoWow. Guess someone faked their leetcode test
- roomor7 4y agoA glitch in the matrix as skynet came online and became self aware. Nuclear launch in 10, 9, 8…
- pigtailgirl 4y ago-- Switching to Seattle on Nord fixed it for me --
- b20000 4y agolooks like leetcode interviews don’t work for finding the right talent with actual skills and experience
- bobobob420 4y agoI just spent the last 7 years of my life memorizing every problem on leetcode and codeforces using different pattern memorization techniques in order to prepare for my entry level software engineering job at Spotify and now you're telling me this? Absolutely riddiculous.
- aoetalks 4y agoReally curious to see how a single (albeit large) DC issue caused a global outage. Further; was the DC not protected by redundant power? Also even more interested to see how this arc flash even happened. Presumably these were experienced engineers working with obviously dangerous power levels.
- shadowgovt 4y ago> how a single (albeit large) That's the reason. In principle, Google distributes execution and data storage for its mission critical applications. And most of the time, they do a pretty good job of that. But (especially with the hardware crunch in recent years brought about by various effects, including COVID and Bitcoin mining putting pressure on the market) their ability to build out new datacenter capacity has stalled, and as a result, things sometimes end up bunched up in suboptimal ways, and a high capacity data center can become a single point of failure even though it shouldn't be. > Was the DC not protected by redundant power? Depending on where the flash occured, it may have been at the point the redundancies feed into the building.
- jeffbee 4y ago> was the DC not protected by redundant power? If this topic is of great interest to you, US Patent 10,678,647 could be fun.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- habibur 4y agoSearched for "is google down" Flashy answer on front page "No"
- QuinnyPig 4y agoI'm seeing no emails getting through on Gmail, even when sending from other Gmail accounts.
- seized 4y agoI thought it was me searching about a Brother laser printer mentioned in another thread on HN... Considering I am in BC it seems like I should be using a closer DC.
- chakalakasp 4y agoCouncil Bluffs datacenter electrical explosion: https://www.ketv.com/article/council-bluffs-google-data-center-electrical-event-three-people-critically-injured/40838924 https://www.ketv.com/article/council-bluffs-google-data-cent...
- mise_en_place 4y agoWorks on my machine
- richardsocher 4y agoGood time to switch to a search engine that has code snippets, coding tutorials, AI code completion, AI blog writing, a useful yelp app, great privacy, gives control over the sources and apps I want to see and summarizes pros/cons for products. you.com (founder here :)
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]