6 ms·
GitHub was down
- veemjeem 13y agoCrazy how many people are affected when github goes down for less than 2 minutes.
- jborden13 13y agoThere goes our plans for a release tonight. This DDoS seems to be a fundamental flaw of popular SaaS services.
- bennyg 13y agoIt's already back up (for me at least).
- jamesbritt 13y agoI happily created a new Github repo, imported some code, made some changes and pushed stuff, all OK. And just now when I want to post announcements of my new library, bam! Github is down. Mostly I don't care if they are periodically unvailable, but the timing on this was amusing.
- wluu 13y agoYeah, there was a brief major service outage according to the status page. https://status.github.com/messages https://status.github.com/messages Today 1:45 UTC Major service outage.
- anthonyb 13y ago2:01 UTC We're still experiencing a large DDoS attack. The site is experiencing major packet loss and is mostly unavailable. We're working to further mitigate the attack.
- heyitsgarrett 13y agoGenuine question – who DDoSes Github? From what I've seen, DDoS attacks often seem to be a response to a site or company entering the political sphere in a controversial way.
- AYBABTME 13y agoIn previous threads about Github being DDoS'd, I asked the same question. Apparently it's some scheme to ask ransom from companies/startups that have enough money to pay and/or not enough infrastructure to sustain the attack without giving up.
- jackowayed 13y agoYep. There's a well-written article about an early DDoS extortion attempt where the victim fought instead of paying, developing some novel protection technology in the proces: http://www.csoonline.com/article/print/220336 http://www.csoonline.com/article/print/220336
- xal 13y agoYea, all of us successful web companies face these all the time. We get them multiple times a day. Most of us end up giving up and pay for Arbor gear and ridiculously over provisioned pipes as well as good relations with our hosting facilities.
- IceyEC 13y agoAdditionally, some group may be targeting a specific project on Github
- not_chriscohoat 13y agoUnfortunately this occurred at the exact moment I was deploying some changes. Makes me think that being so dependent on GitHub for a production code repo is a little big dangerous. Redundancy would certainly solve this issue, though.
- deleted 13y ago[deleted]
- apendleton 13y agoThere's already built-in redundancy. Wherever you pushed to Github from has a complete copy of the current state of your repository. Github is effectively just a publicly accessible mirror, but you can always push to a different remote elsewhere, push directly to your production instance, or even host your repo in an s3 bucket, all while Github is down.
- joeblau 13y agoI've been in some development environments where the GitHub master branch is what the build system pulls from in order to deploy to dev, staging and production. With that setup, it's more challenging since the build process probably involves more steps and potentially ssh keys that are only allow the build server to deploy. Depending on how many repos you need, I would say set up an alternative remote on bitbucket.org.
- not_chriscohoat 13y agoRight, I get that...I meant a separate remote when I said redundancy. GitHub has just been so reliable I haven't even needed other remotes for the past 8 or so months we've been using it like joeblau mentioned.
- readme 13y agoGuys, please don't forget the advantage of using DVCS to begin with. I like Github too, but if Github goes down it shouldn't put the brakes on your work. Push to multiple remotes. Solved.
- deleted 13y ago[deleted]
- dan_manges 13y agoA lot of people rely on other features of GitHub for their workflow: issues, pull requests, comments.
- apendleton 13y agoI've been telling people for a fair while that I wish Github issues were stored as part of the git repos themselves, not so much for availability reasons as that it'd be awesome if the state of bugs got branched and merged along with everything else, so that a bug could be fixed in a branch, but not yet in master, and would get fixed in master when the branch got merged. But I guess availability would be a nice additional perk.
- merlincorey 13y agoYou're welcome: http://bugseverywhere.org/ http://bugseverywhere.org/
- apendleton 13y agoWow, slick. Thanks for sharing.
- edhebert 13y agoWhat I would like to see is an analogue to offlineimap for GitHub's project management services. The protocol could even be email based. e.g. a pull request is an email with the git formatted patch attached. Issues are emails with discussions as threaded mail/news, etc.
- tarellel 13y agoNothing new here, please just move along
- joeblau 13y agoDoes GitHub use a CDN? It seems like that might help them with the DDoSing.
- tedivm 13y agoCDNs are only useful for things that can actually be cached, and which have been accessed recently. Static content is easy, and I'm sure Github does it, but dynamic content doesn't benefit as much for a CDN. As another note, anyone doing a DDoS is going to target parts of the system that are more intensive. They'd just skip the cached things and go after the ones that have to be regenerated.
- joeblau 13y agoThat makes sense, but can't a CDN also help identify the DDoS and block communications from certain servers. I remember seeing a captcha on Adria Richards website after she got those two devs kicked/fired. Maybe GitHub just needs better tools to identify and block the DDoSes quicker.