4 ms·
Current status: bad things are happening in the North Virginia datacenter. EC2, EBS and RDS are all down on US-east-1. Edit: Heroku, Foursquare, Quora and Red
by yuvadam 16y ago
Current status: bad things are happening in the North Virginia datacenter.
EC2, EBS and RDS are all down on US-east-1.
Edit: Heroku, Foursquare, Quora and Reddit are all experiencing subsequent issues.
- samratjp 16y agohttp://status.heroku.com/ http://status.heroku.com/ for those on Heroku
- mike-cardwell 16y agoIs it just me, or is their status page down?
- guynamedloren 16y agoIt's been on-and-off for the past few hours.. It's up right now (for me, anyway).
- amorphid 16y agoThis morning from 5a - 6a Pacific time I was able to access my Heroku app just fine.
- JonnieCache 16y agoI can access all my heroku apps that have their own DNS. Anything with a .heroku.com subdomain is down for me. Frustrating, knowing that the apps are still running but aren't routable.
- cooldeal 16y agoYay, cloud.
- JonnieCache 16y agoPlease do not make content-free posts such as this. It adds no value to the conversation and is only noise. If you actually wish to make a useful point about the practicality or otherwise of massively virtualised systems for webapp deployment, please do. It's going to take more than two words though.
- mtogo 16y agoPlease do not make content-free posts such as this. It adds no value to the conversation and is only noise. If you actually wish to bitch about a post that we all got the point of, you're going to need more than two paragraphs.
- cooldeal 16y agoI guess you haven't seen the Microsoft ads about the cloud? http://www.youtube.com/watch?v=Lel3swo4RMc http://www.youtube.com/watch?v=Lel3swo4RMc Anyway, my bad, I was just trying to make a joke to lighten up the mood. Sorry.
- JonnieCache 16y agoYou're right, I hadn't. Fair enough.
- recoiledsnake 16y agoI laughed, it's relevant and puts things in perspective if you had seen the ads. So it's not really content free even if it's just two words.
- bskari 16y agoI know you probably have your answer by now, but this site always helps me out when I have that question: http://www.downforeveryoneorjustme.com http://www.downforeveryoneorjustme.com
- guynamedloren 16y agoIndeed they are. Right before the issues began, I pushed a bad update to one of my Heroku apps, causing it to crash. A minute later I fixed the bug, re-pushed the git repo to Heroku... and nothing. I've been stuck with an error message on my website for hours. Unfortunate timing!
- potomak 16y agoAlso Cuorizini (http://cuorizini.heroku.com http://cuorizini.heroku.com) is down!
- wmoxam 16y agoNot all EC2 & EBS instances are down. I have several in US-east-1a and 1 is down, while all of the others are working.
- jedberg 16y agoSame with us. About 10% of our 700+ volumes are having problems right now. It's hard to tell for sure since there isn't any load.
- nostromo 16y agoWe're fine on EC2 -- but everything on RDS seems to be giving us big problems. We started a few backups before we new it was systemic, and all of them are stuck at 0%. We also tried spinning up new instances -- and they're all stuck in booting.
- agotterer 16y agoWe had about 45 min of downtime around 4am EST. Our RDS instances, EBS backed and normal instances all returned without problems. We are in Virginia us-east-1a and us-east-1b.
- obfuscate 16y agoI think which physical data center "us-east-1a" etc. corresponds to differs from user to user, to load-balance given that people will probably be more likely to use 1a than the other zones.
- deleted 16y ago[deleted]
- antonioe 16y agoFoursquare is up now. Quora not showing the 503 anymore, Reddit still down.
- antonioe 16y agoI stand corrected. 4sq down again.
- jedberg 16y agoWe rely heavily on EBS still, so this is hurting us more than most others. Hopefully they'll have us back up soon.
- bvi 16y agoYou guys might have answered this in one of your AMAs/blog posts (or was it raldi who commented?), but what options can reddit resort to should this stuff happen again to this degree of severity?
- jedberg 16y agoWe're moving away from the EBS product altogether. The hard part is dealing with the master databases. Normally I'd have a master database with a built in raid-10, but I can't do that on EC2, so I have to come up with another option. So I guess that is the long way of saying that hopefully it won't happen again.
- deleted 16y ago[deleted]