10 ms·
Gmail is having an outage
- gabeh 8y agoGoogle seems to acknowledge the reports now. https://www.google.com/appsstatus#hl=en&v=status https://www.google.com/appsstatus#hl=en&v=status
- gowld 8y agohttps://status.cloud.google.com/ https://status.cloud.google.com/ https://status.cloud.google.com/incident/appengine/19007 https://status.cloud.google.com/incident/appengine/19007 " Elevated error rate with Google App Engine Blobstore API and App Engine Version Deployment Incident began at 2019-03-12 19:49 (all times are US/Pacific). Mitigation work is currently underway by our Engineering Team. We will provide another status update by Tuesday, 2019-03-12 20:45 US/Pacific with current details. "
- etaioinshrdlu 8y agoStatus page is down for me.
- kerng 8y agoThese are the not that well designed scenarios, when the status pages are hosted on the very same infrastructure that suffers an outage. This is a common pattern across cloud providers I have seen happen.
- cheerlessbog 8y agoThat page is not very color blind friendly, incidentally. The information is distinguished only by color.
- tomcam 8y agoAren’t the icons all different?
- manigandham 8y agoNo, they're all circles but in different colors. EDIT: you might be looking at the Google Cloud status, not the Google services status in the first post.
- culturestate 8y agoNot for me - 'available' is a checkmark, 'service disruption' is an exclamation point, and 'unavailable' is an x. (I notice though that they're images, not text icons, which isn't ideal.)
- crazygringo 8y agoWeird. Clearly Google is serving up different versions to different people. To me they're 3 different colors of circles, no symbols whatsoever.
- culturestate 8y agoIt's more likely that your browser just isn't loading the CSS background images for some reason. If you inspect the circles, do you still see the background-image declaration?
- bschwindHN 8y agoHere's what I see: https://imgur.com/IrL5JBo.png https://imgur.com/IrL5JBo.png
- manigandham 8y agoYou're talking about the Google Cloud status page which is in the 2nd post: https://status.cloud.google.com/ https://status.cloud.google.com/ This thread is about Google Services linked in the top post which only shows circles: https://www.google.com/appsstatus#hl=en&v=status https://www.google.com/appsstatus#hl=en&v=status
- crazygringo 8y agoThe orange dots are much darker and the green ones are much lighter. I'd assume anyone who is colorblind can still distinguish between the two based on brightness and not color? Is there any reason to think that's not the case?
- culturestate 8y agoIf the user had e.g. red/green colorblindness, that wouldn't help. Google's made a nice tradeoff for this application, though, and used differently-shaped icons (checkmark vs. exclamation point) as well. Edit: looks like the icons are served as images. Google should probably consider making them text icons instead to mitigate loading problems. FYI, Toptal makes a helpful tool for quickly checking live pages with colorblindness filters: https://www.toptal.com/designers/colorfilter/ https://www.toptal.com/designers/colorfilter/
- manigandham 8y agoYou're looking at the wrong page. This thread is about https://www.google.com/appsstatus#hl=en&v=status https://www.google.com/appsstatus#hl=en&v=status
- culturestate 8y agoAhhh, got it now, thanks!
- tzs 8y agoHeck, I'm not colorblind and I had trouble seeing the difference between "service disruption" and "service outage" at first in the legend at the bottom of the page. It wasn't until I zoomed in on them that I could see that one was orange and the other red. Once I saw them zoomed, I could then identify which was which at normal size on the status part of the page. BTW, the orange circle is actually a span whose class is "aad-yellow-circle", and whose CSS loads the colored circle from the file yellow_circle.png. This suggests that at one time they intended it to be a yellow circle, not an orange circle [1]. I wonder why they switched from yellow to orange? [1] Actually, RGB to name sites suggest that it is neon carrot.
- R4V3 8y agoHit that feedback button in the bottom corner.
- skrebbel 8y agoYou're kidding, right? Sending feedback to Google? I mean isn't that a bit like talking to a tortoise?
- rattlesnakedave 8y agoIn general, maybe, but they take accessibility concerns very seriously in my experience.
- Pristina 8y agoColorblindness is the veganism of the web.
- bryanrasmussen 8y ago?!? because people choose to be colorblind? I was not aware of this!
- richjdsmith 8y agoI mean, playing board games is kind of a bitch sometimes as well. I was trying to play Ticket to Ride on Monday and that was exciting. Good thing I chose this in the same way people choose not to eat certain foods, right?
- acct1771 8y agoPropose solutions.
- richjdsmith 8y agoHonestly, it's not hard. Just don't design everything around color. On ticket to ride, the grey lines ones have a dot or shape in the middle whereas the black ones do not. I can see that dot, but it's small. If it was larger then the problem would be solved.
- throwaway77384 8y ago
- 0x8BADF00D 8y agoNoticed this a few minutes ago. It’s pretty rare for Google to have an outage, don’t they have massive replication and failover?
- baroffoos 8y agoYoutube was down for a few hours late last year.
- rubicon33 8y agoFine here in CA.
- stevenwoo 8y agoI'm in Mountain View, receiving/sending email works but downloading full size attachments does not for me personally.
- taeric 8y agoI just emailed some folks images. Got a few warnings of something going wrong, so I then checked in my outbox. It showed that the images went, but there was a message that the "virus scanners were down, download at your own risk." Or some such. Seems to be back to working now, so I just assumed it was a time delay. Edit: Just saw it again. Full message is: Gmail virus scanners are temporarily unavailable – The attached files haven't been scanned for viruses. Download these files at your own risk. First time I've seen something like this, actually kind of glad they had this failure case coded for. :)
- muststopmyths 8y agoI've been seeing that for the last couple of weeks, off and on.
- taeric 8y agoMy guess is there is always a time delay of some sort on files. The transient "something went wrong" errors were surprising.
- rconti 8y agoThat error happens all the time on files it can't handle; i think .tgz type files come to mind.
- phantom784 8y agoAlso Mountain View, but had issues sending/receiving as wells. I'm on Comcast, you?
- AndrewWarner 8y agoYouTube seems down too: https://outage.report/youtube https://outage.report/youtube
- deleted 8y ago[deleted]
- byoung2 8y agoI was trying to send an email and kept getting "Oops there was a problem" errors, but it appears to be working now.
- deleted 8y ago[deleted]
- Someone1234 8y agoIt isn't just gmail, Google Music, Google Play, Google Drive, and others are also impacted. Seems to be a large scale Google outage of some kind.
- noitsnot 8y agoAdd YouTube to the list.
- sitkack 8y agoYoutube was giving me 500s in ways that have never occurred before.
- jsaxton86 8y agoYouTube seems to be in this amazing degraded state for me where videos play just fine, but it isn't showing me ads.
- ashelmire 8y agoThat state is called “using ublock”.
- deleted 8y ago[deleted]
- deleted 8y ago[deleted]
- palerdot 8y agoI was in the complete messed up scenario. Youtube loads ads fine, but after playing them, was not able to load the actual content.
- eeeeeeeeeeeee 8y agoHah I had the opposite. All my ads were playing fine but not the actual videos.
- 8y ago
- sureaboutthis 8y agoNo issues here in the Midwest.
- cableshaft 8y agoSame, at least not yet. Chicago area here. It does seem slower than usual, but might just be my imagination.
- deleted 8y ago[deleted]
- quickthrower2 8y agoAll Ok in Sydney
- laurencei 8y agosame - I'm in Sydney - no issues (so far). Perhaps it's user based, rather than location based?
- codemati 8y agoSeems to be. I'm on the same network as others not having any issues.
- PudgePacket 8y agoHaving issues in Sydney :)
- rorykoehler 8y agoHalf of my colleagues had issues in Sydney. OK in Singapore apart from images attaching to docs in drive
- AceyMan 8y agoCan confirm wrt Drive. I was just at work trying to upload files (and one-deep folders) and barely anything completed. I finally gave up. Our edge/gateway is in metro SEA, fwiw.
- ardenpm 8y agoDefinitely having problems in Melbourne, Australia
- samplatt 8y agoGMail's working fine for me (8min later) in Melbourne, Australia.
- prawn 8y agoIn Adelaide also. Things I'm experiencing: can't reliably download attachments in Gmail messages not getting through in Hangouts constant "Oops" auto-save modals when typing Gmail messages
- Gustomaximus 8y agoBrisbane too - Google Photos would sync about the time you wrote this comment.
- fourier_mode 8y agoWorks fine in Illinois.
- mnyary 8y agoHaving problems in Budapest, Hungary.
- mav3rick 8y agoWhat's the tech scene in Budapest like ?
- samstave 8y agoHe told you already, Hungry.
- warp_factor 8y agoit's funny, not sure why you are downvoted
- the4ner 8y agodrive, maps, photos all having issues as well
- simonhorlick 8y agoI'm getting a ton of 503 Service Unavailable errors from the Google Drive API. I can't wait to see what caused such a large outage.
- carmate383 8y agoCan't attach files to drafts nor send emails from Philippines
- rum3 8y agoHopefully it never comes back up Edit: Because then maybe people will realize that centralization is bad
- mav3rick 8y agoWhy the negativity. Mistakes happen ?
- cmroanirgo 8y agoMaybe think of it more as an opportunity to remember how we've let ourselves be lulled by this behemoth. Google itself is pretty much a spof for most of the world. If Google is down, so is business. Of course, the report afterwards will be very interesting, while we pick apart the reasons on what and how it failed.
- rum3 8y agoI am not affected by this outage but I get a bit angry when I think about how many people are. In a better world it would affect much fewer people.
- hobbified 8y agoThat's pretty fundamentally stupid.
- 8y ago
- bluenose 8y agoElizabeth Warren is winning :(
- nickchuck 8y agoSHE'S HACKED THE SYSTEM
- jhgg 8y agoThe root of this is definitely GCS. We noticed some keys in a GCS bucket go inaccessible since like 19:15-19:20ish PDT, and then we noticed increased timeouts/503's ramping up at 19:30 and plateauing at 19:45. But error rate for us seems to have gone back to nominal levels since 20:10... but the keys that originally went unavailable are still returning 503's. Fun times.
- jedmeyers 8y agoGCS might be relying on the same system as Gmail/YouTube does, so it’s not necessarily GCS itself. Spanner?
- parent5446 8y agoBlobstore
- mehrdadn 8y agoIt will be very interesting to see what timing issues might be involved if this is indeed due to Spanner.
- ohaideredevs 8y agoIf Google's GCP marketing material is to be believed, you are truly on their infrastructure on GCP, so if GCP is having issues so are Google's main services.
- jchallis 8y agoDown in Singapore
- dickeytk 8y agoI had trouble replying to an email but it worked once I removed the images inside the quoted signature. Makes me think this is file-related.
- minikomi 8y agoStreet view is iffy as well
- graposaymaname 8y agoFine here in Kerala, India.
- EpicEng 8y agoWorking fine in Austin TX
- giarc 8y agoDown in Calgary still (10:24pmMST). Was going to do work but not confident my email drafts will save.
- awal 8y agoMy bad guys. I'm running out storage space on my google account and I think I might have pushed it over.
- sn_master 8y agoGoogle Photos too. Unable to download images :(
- nukemandan 8y agoFirst time this has happened to me. Historic moment. Might be time to get less completely reliant on google?
- nukemandan 8y agoAND we are back
- nukemandan 8y agoMay I ask - why the downvote? I know it was a blip, but still, a reminder for a moment that most of life relies on them. And some of my data is not replicated else ware... that is changing.
- 908087 8y agoThis forum is crawling with Google employees, shareholders, fanboys and others who have a vested interest in the continuing centralization of the web/internet. Suggesting that people should stop relying on one of the largest centralizing forces out there will generally result in downvotes for that reason.
- diminoten 8y agoI personally downvoted because of how a single incident is being extrapolated into a new trend by you, and that feels unhelpful/fear mongering.
- zerop 8y agoIs Gmail onto kubernetes?
- ttul 8y agoI think it may be a touch beyond Kubernetes.
- hknd 8y agoGoogle is not using kubernetes internally but it's predecessor "borg". Kubernetes was build from scratch with the same idea, but not used internally. https://www.quora.com/How-are-Borg-and-Kubernetes-different https://www.quora.com/How-are-Borg-and-Kubernetes-different
- londons_explore 8y agoThe general sentiment seems to be that Kubernetes is better than Borg in almost all ways. The only thing keeping Google on Borg is the massive amount of work to migrate.
- BucketSort 8y agoLiving for the postmortem on this one.
- bsilvereagle 8y agoAs far as I know, there wasn't a public postmortem for the Oct 16, 2018 YouTube outage. Based on that, I'm not expecting one for this outage.
- jpatokal 8y ago"Red" incidents on the GCP status dashboard, like this one, will typically have public incident reports. Disclaimer: I used to work in GCP Support, but no longer do.
- afniljl 8y agoYouTube ain't a Gsuite service with SLA. So this is much more likely to have a public report. Whether it's detailed or not is another thing. Also it's probably due to the underlying GAE or GCS issue is my guess.
- jimmy_ruska 8y agoSorry, Bill tripped on the server cable
- sachin18590 8y agolol. email outage is the new dog ate my homework
- deleted 8y ago[deleted]
- nopacience 8y agoThere are good alternatives: runbox.com *kudos for runbox.my account is 5 years old https://restoreprivacy.com/secure-email/ https://restoreprivacy.com/secure-email/
- vinayan3 8y agoIn CA. Colaboratory Research is experiencing issues loading and saving notebooks in Google Drive. Sad :(.
- wybiral 8y agoHappy 30th birthday, Internet. Enjoy your consolidated cloud infrastructure.
- kerng 8y agoFitting that something like this happens when we celebrate 30 years of the decentralized world wide web!
- wereHamster 8y agoOnly (some) Google services are affected. My email still works, as it's hosted elsewhere.
- ian0 8y agoEmail is working for me, but attachments are failing. Opening up the console and it has a message about a database connection loss.
- skilled 8y agoAttachments are definitely down for me. Can't view received images.
- ssambros 8y agoIf anyone is interested: Memorystore for Redis is experiencing intermittent failures during instance creation. Existing instances are not affected.
- ghthor 8y agoMercury, god of communication, retrograde is kicking it up a notch this year.
- 908087 8y agoGoogle forgot to charge their energy crystals?
- mholt 8y agoOf course this would happen while I'm trying to submit my thesis at the last minute. https://twitter.com/mholt6/status/1105703745143205889 https://twitter.com/mholt6/status/1105703745143205889
- cedricium 8y agoGoogle Maps (specifically Street View) is showing up as a black screen for me as well.
- xbmcuser 8y agoSeems to me a location specific breakdown as all services I tried like gmail, photos and youtube all are working for me
- config_yml 8y agoProbably caused by a typo in the configuration for the new region they just launched ;)
- aj7 8y agoIs having to load two tabs of gmail to get my mail to actually appear also a type of outage?
- bluedino 8y agoSo this is why we couldn't send emails last night (9pm est) Watched Youtube instead :)
- Tsubasachan 8y agoAh gmail. Where spam goes to die.
- QuamStiver 8y agoHappy that I was sleeping at that time.
- thrusong 8y agoI thought outages weren't supposed to be posted here? Every time I've posted one about Facebook, it's been flagged and removed.