13 ms·
GitHub's down?
Getting the unicorn on any pageload
- kbwt 11y agoYes, response times seem to have spiked: https://status.github.com/ https://status.github.com/ Could be another DDoS? --- Update 11:32 UTC "We're seeing high error rates on github.com and are investigating".
- johannesboyne 11y agoyep
- runn1ng 11y agohttps://status.github.com/messages https://status.github.com/messages >Today >11:32 UTC "We're seeing high error rates on github.com and are investigating". >11:40 UTC "We're doing emergency maintenance to recover the site".
- smoyer 11y agoAlong with the switch to the Octocat "We're down for maintenance" message.
- kjjw 11y agoJust noticed an interesting design decision on that page. An 'everything OK' message once a day. One way to push previous downtime below the fold of the page.
- ateevchopra 11y agoNotice the change in the favicon.
- DCoder 11y agoIt's also a way to show "yes, this status check is still reliably doing its job, it hasn't crashed".
- kjjw 11y agoOK I could take that as a reason.
- deleted 11y ago[deleted]
- nothrabannosir 11y agoRightfully so; humans are notoriously bad at interpreting sparse data on a linear scale.
- globuous 11y ago> 11:54 UTC We've finished emergency maintenance and are monitoring closely. it's back
- tragic 11y agoI'm just getting unicorns everywhere. Sprint review in an hour. Damn, I love wednesdays.
- smoyer 11y agoTo me, that looks like an angry unicorn ... does that mean it's another DDoS? It would also be interesting to track loss of productivity in the software engineering professions when GitHub is down. Is this a single point of failure for your company?
- sbarre 11y agoNot just for a company, but for developer productivity in general, professional or not... Think of all the package managers that pull straight from Github repos as part of their installation processes..
- smoyer 11y agoExactly ... we've got Ansible scripts that do that. One of the current Java rockstars (not my description), Adam Bien, recommends pulling the source code for all third-party dependencies to build them locally and put them in a local repository. I suppose you can push directly back upstream to avoid having an extra step.
- sbarre 11y agoFor OS-level package management like Apt or Yum this is less of an issue, but for things like Composer, Gem, NPM and the like, is the concept of "closest available mirror" even a thing? I guess for mission critical applications you could have a local mirror of all your vendor package dependencies (probably not a bad idea) but I would bet most people don't do that (I don't)..
- flipp3r 11y agoIf you're using Java most of the build tools use the Maven repositories, for which you can set up a local mirror too. The company i work for runs a Sonatype Nexus so we're not really affected by others' downtime unless we need stuff that we hadn't ever used before.
- smoyer 11y ago
- mohsinhijazee 11y agoHad to deploy an important service. And github is down.
- andygmb 11y agoperhaps a good time to reconsider depending on a third party for your important services to deploy?
- mohsinhijazee 11y agoYes, but these decisions aren't under me plus setting up a github kind of thing is way too time consuming with all the features that we're used to now.
- andygmb 11y agoUnderstandable, but surely the potential disruption if github was to go down for a long time or indefinitely would be more than setting up a local git server that you control?
- jballanc 11y agoA GitLab droplet on Digital Ocean should run you only $10/month and literally sets up in ~10 min.
- netheril96 11y agoWhat makes the servers of digital ocean safer than github?
- jballanc 11y agoThey're not GitHub. i.e. The chance of GitHub and your GitLab instance on DO going down simultaneously is very slim. Spend an extra $10/month and you can set up another DO server in another data-center, and reduce the odds of simultaneous failure even further.
- AdrianRossouw 11y agothe d in github stands for distributed
- elcct 11y agoIt wasn't me
- elcct 11y agoIt wasn't me
- ivan_ah 11y agoThe 'one' day that I wake up at 7AM to get some quality caffeinated work done, and I can't pull. It's all good though, I still have loco host to keep me busy until their resolve the issue.
- sbt 11y agoTime for a sword fight!
- setrofim_ 11y agoFor those confused by this: https://xkcd.com/303/ https://xkcd.com/303/
- _ikke_ 11y ago11:40 UTC "We're doing emergency maintenance to recover the site".
- bwghughes 11y agoYep. Down for maintenance.
- jballanc 11y agoFor everyone who is currently loosing productivity, perhaps your time might be well spent reviewing `git daemon`: http://git-scm.com/book/en/v2/Git-on-the-Server-Git-Daemon http://git-scm.com/book/en/v2/Git-on-the-Server-Git-Daemon
- sp4ke 11y agoOr setup Gitlab for bigger teams, they even offer a Docker image.
- znpy 11y agoThere's even an AMI image for Amazon ec2 hosts IIRC, which brings down the costs when coupled with a reserved instance.
- jobvandervoort 11y agoYou can also run `sudo apt-get / yum install gitlab-ce` nowadays.
- sytse 11y agoYou remember correctly, it is available on https://about.gitlab.com/aws/ https://about.gitlab.com/aws/
- Xylakant 11y agohow does that help for the long long lists of external dependencies, for the bugtrackers of projects where I'd like to look up if someone else had the same issue and maybe there's a workaround, to view and compare code for older revisions of projects I'm using? With a ton of projects now hosted on github, github being down is a major dent in my overall productivity even though we _do_ have an internal git server.
- DCoder 11y agoFor repositories your projects depend on, you can set up a local proxy so you at least have local copies for continuous integration. E.g. PHP's Composer project has _Toran_ and _Satis_ for this: http://tech.m6web.fr/composer-installation-without-github.html http://tech.m6web.fr/composer-installation-without-github.ht...
- sp4ke 11y agoFunny, I switched our projects to Gitlab a week ago and told the team: Because we should not trust a centrealized platform to keep our code decentralized.
- znpy 11y agoThat is Murphy trolling you very, very hard.
- sytse 11y agoGitLab CEO here, I might be missing the joke here, GitLab is a decentralized solution you run on your own servers. Maybe you are confused with GitLab.com?
- shankerhrm 11y agoYes, Gitlab.com is not having hosting services.
- sytse 11y agoUhhmm, GitLab.com has hosting services https://about.gitlab.com/gitlab-com/ https://about.gitlab.com/gitlab-com/ Most people use GitLab to refer to the downloadable software you run locally https://about.gitlab.com/downloads/ https://about.gitlab.com/downloads/
- richardwhiuk 11y agocorrection: GitLab is a centralized solution you run on your own servers - you end up with a replicated central set of hosts.
- jbbarth 11y agoIs it? Having it hosted on my servers doesn't make it decentralized: it's just centralized in a place I own. If the server(s) go down, same problem as Github (except I may be able to take action). Right?
- Already__Taken 11y agoI was uploading a new profile picture sorry everyone.
- rghose 11y agoDamn you github. Just tried making my first push in my new company and boom! wasn;t me
- miloc_c 11y agoYes it is!
- Macha 11y agoSE yesterday, gh today. Bad week for dev productivity.
- philippnagel 11y agoSE?
- thecatspaw 11y agostack exchange I assume
- crylics 11y agoStack Exchange.
- liquidmetal 11y agoNot again.
- bvrlt 11y agoThat's when you notice how dependent you can be on GitHub. You would think you can still develop an iOS app when GitHub is down, but a simple `pod install` requires access to repos hosted on GitHub.
- alekfeel 11y ago:)
- erikzaadi 11y agoSo the DDOS is basically all of us accessing status.github.com right?
- liamcode 11y agolooks like its time to go for lunch
- mrmondo 11y agoSo glad we don't rely on GitHub for our deployments anymore, we haven't had an outage to git in the past year yet it seems GitHub goes down more often than people realise. Obviously DDOS attacks are nearly impossible to mitigate for anyone but it should serve as a reminder of companies dependencies on external services. Somewhat related I highly recommend both Gogs and Gitlab for internal git hosting.
- delinka 11y agoProbably people trying to clone curvytron because curvytron isn't currently playable at its own site. It's like an unintentional pub crawl-- 400 people show up to party, empty the pub of booze, move on to the next pub that hasn't enough booze...
- alelepore 11y agoit's up
- cgabios 11y agoHopefully the responding on-call engineers aren't tired folks but folks in other timezones. The reason that the risk of compounding the situation is lessened, because trying to fix important shit when tired is like driving without a seatbelt. Update: seems to be back, so it doesn't matter unless someone's having an early morning.
- zymhan 11y agoProbably? This is a very random concern to have, why would you think that Github has problematic on-call procedures?
- dujiulun2006 11y agoOK it's back.
- hoangddt 11y agoThe site is live now
- cgabios 11y agoSeems to be partly up, hurray! (maybe) Update: "We've finished emergency maintenance and are monitoring closely".
- ruban 11y agoIS there any opensource private github?
- thecatspaw 11y agogitlab
- scottlinux 11y agohttps://about.gitlab.com/ https://about.gitlab.com/
- semirami 11y agoit's back
- semirami 11y agoit's back now
- davidgerard 11y agoBack now! Orange octocat, "We've finished emergency maintenance and are monitoring closely".
- colinbartlett 11y agoA few projects can help you monitor this: Octobot iOS app: http://octobotapp.com http://octobotapp.com And my own service, StatusGator: https://statusgator.io https://statusgator.io
- ff_ 11y agoUp again! 11:54 UTC "We've finished emergency maintenance and are monitoring closely".
- infectedio 11y agoJust use https://git.directory/ https://git.directory/ :D
- sytse 11y agoCool to see you set up a GitLab instance for others to use, I had not seed that TLD before.
- infectedio 11y agoThanks for GitLab!
- sytse 11y agoYou're very welcome, thanks for spreading the word.
- _lce0 11y agoNeither do I. Seems their are managed by donuts.domains http://www.donuts.domains/ http://www.donuts.domains/
- jbernardo95 11y agoBack up !
- deleted 11y ago[deleted]
- paufr 11y agoit's weird
- deleted 11y ago[deleted]
- sidcool 11y agoIt's back to normal. Back to work guys!!
- winterbe 11y agoEvery time GitHub is down I'm peering at Upsource: https://www.jetbrains.com/upsource/ https://www.jetbrains.com/upsource/
- merb 11y agoUpSource IS not a repository. It is just a Viewer for your repository. You still need to host everything yourself. As you can see here: > https://www.jetbrains.com/upsource/roadmap/ https://www.jetbrains.com/upsource/roadmap/ Git hosting is on the roadmap, not ready yet. Also Upsource takes a shitload of memory.
- brudgers 11y agoI read about Github being down and know that it sucks for many people. What I find interesting is thinking about how quickly so many installations of distributed version control adopted a de facto central server. Github is a platform that should not need a particularly high uptime from the point of view of any one user. But of course it does because so much of its utility is that it substitutes for a lower level partition strategy for source code version control at the level of the individual user. By which I mean that the whole point of distributed version control is to have sufficient resources for working at hand regardless of what is happening remotely as the default condition. Git is designed to be available and partition tolerant. Using it with the expectation of consistency is a mistake and Git requires manual intervention on the part of users to even get good-enough-consistency. Github can't change that. None of which changes makes Github being down not suck for the people for whom it sucks.
- coherentpony 11y ago> Github is a platform that should not need a particularly high uptime from the point of view of any one user. This is totally false. GitHub doesn't just provide a git server, it also provides ticketing and project management. When GitHub is down, projects that rely heavily on, for example, commenting on issues grind to a halt. Yes, you don't need GitHub to be up 99.999% of the time to do a `git push` every once in a while, but there are other projects that use other features of GitHub besides the git server aspect.
- tenfingers 11y agoAnd it's a shame this is the case, though. I do publish projects with github because of the popularity of the platform, but I really don't approve github pull requests, and I also don't like github over-simplified issues. Together, these two features are probably what most projects depend on. Github pull requests are definitely inferior to the patch-by-mail approach for a conversation within a closed group of people. It's clicky and looks friendly, but you don't have the patch to see in the mail notification (you have to be online), and again it's more convoluted to edit/apply using vanilla git. Many people don't know, but git makes patch-by-mail handling extremely convenient to handle. In fact, it's more convenient to handle than using the several github command-line interfaces I tried(!). You submit the patch, have a conversation by regular mail, and then either edit the patch or merge it. Everything is always right there. Using github you have several side effects: people often add comments to specific lines in the patch, which will looks like garbage in the generated github notification. People will also naturally edit the comments, which won't generate notifications. I cannot count how many times I have to re-read comments because I had the feeling I missed something (and indeed, some comments were edited). This is bad. It shouldn't be allowed. It cannot happen with email. Github has the advantage of making the conversation visible. But if you have a developer mailing list for your project, git and plain, regular patches do work really well. It might take a bit more to get used to, but it pays back. Issues are a different problem, since I still feel the distributed solutions are inferior. I experimented a lot with bugs-everywhere and simple defects (sd), two distributed bug trackers that store the issues in the repository itself. Both are nice, and have distinctive features from each other which I'm not going to discuss much. The main thing is that 'sd', at some point, even supported to sync issues with github, which allowed to have best of both worlds. Unfortunately, it's lacking maintenance at the time, but it would solve ticketing in a distributed way. It looks like there's not much interest in this, as both projects are definitely not as active as the many available github clients which do 1/10 of what these projects offer. Please, look into these two projects.
- ksk 11y agoI thought git was all about decentralization?
- _1284267234 11y agoGithub is down again! And Slack too. The only page of slack.com that is available is their status page that says: "All's good under the hood, boss! Slack is up and running normally". UTC/GMT 19:06
- _1284267234 11y agoSlack is up. And github too.