11 ms·
GitHub down
- nik736 9y agoWhy do they even have a status page if it shows nothing and was updated "a day ago"...
- shawabawa3 9y agoStatus page updated. I guess they wait a few minutes to reduce false positives.
- deleted 9y ago[deleted]
- tneely 9y agoIt's updated now.
- mynameisvlad 9y agoI mean, no system is perfect. Maybe their status page only queries their site every 5 minutes? Give them a break. As of 7:20AM PST, it's on there. So it took them 4 whole minutes since this thread was created to get it on there. That's pretty good response.
- lvh 9y agoIt’s been on Hacker News for two minutes. Your reply is one minute ago. Perhaps you should check your SLA with GitHub, but presumably it doesn’t say that 60 second delays is the same as the status page being effectively useless. Also, it was updated by the time you posted your reply...
- geerlingguy 9y agoThey're taking a page out of AWS' playbook :D
- nezza-_- 9y agoWe centralized a decentralized version control system.
- shawabawa3 9y ago$2 billion to the first person to draft a decentralised git coin WhitePaper
- coding123 9y agoI think you just did.
- drdaeman 9y agoNo. We need a proper whitepaper explaining how to make GitHub decentralized with blockchain tokenization using distributed smart-contracts. ;) (Did I forget any important buzzword?)
- karlmcguire 9y agoJust don't host it on Github Pages.
- deleted 9y ago[deleted]
- zbentley 9y agoDid I forget any important buzzword? Nah, but you could always add some Serverless and Lambada to make it more Agile.
- JohnStudio 9y ago"crypto" baiting is like the funniest trend ever in the Stock Market lately. Kodak is riding that pony home ... (noting I live in Buffalo, just down the road from Kodak's home turf in Rochester and I'm a pretty avid photographer - http://www.instagram.com/crispyfotos/ http://www.instagram.com/crispyfotos/).
- rayboy1995 9y agoStatus page apparently isn't automatic because it is yet to be updated.
- sdruskat 9y agoHas been done now. https://status.github.com/messages https://status.github.com/messages.
- dexterdog 9y agoIs that better or worse than stripe who updates their status page saying something is wrong all of the time and then just changes it back without noting any problem in the history? I get alerts on them 4-5x/week and only maybe one of those winds up as a colored entry in the history. ...and sure enough, shortly after writing this it was 'down' for 10 minutes and came back up with the status page saying nothing about it.
- drdaeman 9y agoSeems that it is automatically generated, though, because it's now "The status is still red at the beginning of the day" all over.
- ninjakeyboard 9y agoyep.
- 297mxq 9y agoGit blame --help
- octo_t 9y agohttps://status.github.com/messages https://status.github.com/messages has more info.
- 4ver 9y ago:/ even the status page is broken "The status is still red at the beginning of the day"
- deleted 9y ago[deleted]
- d4nyll 9y agoNow the status page is updated, but the status on previous days are all saying "The status is still red at the beginning of the day"
- dx034 9y agoProbably a quick update just to get the current downtime on the page.
- CoffeeDregs 9y agoI saw that, too, and was fairly concerned. A smoothly running, quality focused engineering organization doesn't leave a status page un-updated for 3+ weeks... Also, "reports of service unavailability"? I would expect monitoring tools to be screaming...
- sverhagen 9y agoThey had an outage happening a few days ago, and I happened to be looking at the status page. It appeared that days in the past were just showing the current status. It went orange, all days past went orange. I refreshed again, it went red, all days past went red.
- deleted 9y ago[deleted]
- willejs 9y agoIt is only a matter of time before someone here suggests you use self hosted gitlab/github enterprise. Ain't got time for that.
- willejs 9y agohttps://news.ycombinator.com/item?id=16124595 https://news.ycombinator.com/item?id=16124595
- castis 9y agoIs it so absurd that some people would want a service they use on a daily basis to be stable?
- willejs 9y agoYou nearly had me there.
- javamelon 9y agoThat is why self hosting is not the best solution.
- apple4ever 9y agoActually, that's exactly why self hosting is the best solution.
- castis 9y agoonly if you don't understand what you're doing.
- carlivar 9y agoTime allocated for this used to be a given. It's interesting how quickly we have moved to SaaS. Though if your internal IT team had a VCS outage, it wouldn't be Hacker News news. Really it is just the scope of the outages (and commiseration) that has changed.
- lihes 9y agoThat's the moment when you know why you're using a decentralized version control system. You don't care about the central server.
- neosavvy 9y agoUntil you need to PR a change to get it to production.
- scott_karana 9y agoIf you can't merge to master decentrally, that's not Git's fault.
- leeoniya 9y agothis PSA is quite unnecessary when a problem is universally known and maximally severe.
- jeppz 9y agoWell I didn't know, not everyone uses it on a daily basis.
- leeoniya 9y agoso is it interesting for you to know that a service you don't use daily is down for a couple hours? this random github outage happens basically every other month, and is fixed in like 30 minutes. every time it's on HN frontpage. people who use Github will already know.
- couchand 9y agoMaybe it will prevent some folks from refreshing the page and possibly exacerbating the issue?
- leeoniya 9y agoso, front page of HN is a good way of alleviating server load?
- dx034 9y agoIt helps to spend the time people have now that they can't use GH.
- 9y ago
- sdruskat 9y agoIf all goes belly up there is always Software Heritage (https://www.softwareheritage.org/ https://www.softwareheritage.org/).
- d4nyll 9y agoGitHub just wants to show off their Unicorn artwork.
- curry_maker 9y agoNow we should start a "Developer-0" kind of thing.... the guy who screw up that shit deserves a second chance... maybe a promotion...
- rqwerty 9y agowhat is this, facebook?!?
- curry_maker 9y agoGitlab did something like that not too long ago.
- deleted 9y ago[deleted]
- pselbert 9y agoJust recently I thought to myself "it has been a long time since I saw the Github Unicorn". As it turns out, I didn't really miss it at all. Regarding the centralized nature of Github: it is the centralized communication that is a problem, not the ability to share code. I can easily send a patch to somebody on my team, but that doesn't help me review a PR, reply to comments, trigger a CI build, or initiate a deploy. Code sharing is only a small part of what a team relies on Github for.
- Tobani 9y agoFurther I think these are things that are generally harder to decentralize. I'm not sure how much marginal value there is doing so.
- kemitche 9y agoYup. Half the comments in this thread are "oh you could do issues in git or something." No, when my PM asks me if bug 123 is fixed, I want a single source of truth. Whether that truth is GitHub, JIRA or something else, it's still a single point of failure.
- PurpleRamen 9y agoMaybe the best way would be to put those wiki/issue/whatever-data in the repository itself and just build tools to throw at them. This could be github, gitlab or something local.
- Shoothe 9y agoThere is a decentralized review system based on Git. Take a look here: https://github.com/google/git-appraise https://github.com/google/git-appraise ...oh, wait...
- curry_maker 9y agoAmerica runs on Github!
- TickleSteve 9y agoThis is why you don't rely on third parties for your build dependencies!
- myspy 9y agoI don't need the free time right now :( Time to get a coffee.
- d4nyll 9y agoIf the stars align and Stack Overflow goes down too, I can just go home.
- slig 9y agoYou can use the cached version from Google.
- snvzz 9y agoAll the "diversity" nonsense finally shows its consequences.
- scoot 9y agoApparently the status has been "red" every day since December 1st: https://status.github.com/messages/2017-12-07 https://status.github.com/messages/2017-12-07 "The status is still red at the beginning of the day" Yesterday was the first "normal" day, before this outage.
- dx034 9y agoThat was different before. They likely changed some historic data when they put the current issue online. Probably just pushed out a quick update.
- neosavvy 9y agoYeah I bet these guys will have this fixed in no time. If you manage your own instance you are bound to have a less entertaining landing page when it breaks. I've worked on numerous enterprise git servers - they all inevitably go down for at least a half day every 6-9 months.
- d4nyll 9y agoThe status page is broken, it was mostly green 10 minutes ago.
- rom1v 9y agoThey should provide a status page for the status page.
- kuon 9y agoIt's been only 7 minutes and I already noticed it (outside of HN), we rely too much on github :P
- Narann 9y agoIs there any relation with bitbucket shutdown few days ago?
- cobbzilla 9y agoSo happy I moved our dev team to Gitea earlier this year. Already paying dividends!
- kubbity 9y agoI refreshed a page and boom ... . Check status, but that was not updated yet. Friday is coming sooner! :)
- dx034 9y agoFrom twitter: http://classicprogrammerpaintings.com/post/144953638470/github-major-service-outage-georges-seurat http://classicprogrammerpaintings.com/post/144953638470/gith...
- bobcallme 9y agoThis is why it pays to host your own source repositories. It is kind of shocking that many people with the skills and means are too cheap to host their own. I personally could not risk github deleting my repositories or (in this case) going down for any length of time.
- piaste 9y agoThough in an alternate universe where somebody's self-hosted server went down in flames (possibly literally), one could just as easily say: This is why it pays to have your own source repositories in the cloud. It is kind of shocking that many people with the awareness and means are too cheap to pay for a GitHub private repo. I personally could not risk a careless sysadmin deleting my repositories or (in this case) going down for any length of time. The obvious answer is to have both, but smooth synchronization isn't always easy or even available.
- deleted 9y ago[deleted]
- swiley 9y agoEh, self hosting stuff is a hassle and I'd be willing to bet most people are more concerned about the time/reliability than the cost. I use gh pages for the static parts of my own site even though I have a web server (which I use for quickly sharing files and whatnot) because GitHub is less likely to leave things broken than I am.
- lykr0n 9y agoThe problem is that if you spin up a GitLab in DO or Linode, there is a chance that your VM will get lost due to hardware failure. You also need to manage backups and stuff. I'm right there with you, but it doesn't make sense for small teams. Once you get past a point, it starts to make sense to self-host some stuff. Is there a managed hosting provider that would host all this stuff for you? Like, say "I need GitLab, Jira, Active Directory, and X, Y, Z" and they come back with "$XXX/month for 10 users"?
- ryanpcmcquen 9y agoAnyone know specifics? They handled that DDoS attack really well not too long ago ...
- jdmoreira 9y ago... and there are queues for all ping pong tables around the globe.
- rplnt 9y agoWhile I kind of hate Atlassian products (bloated, horrible APIs), and Bitbucket has some serious UX problems (Find), it's still better than have your repos be offline. There's not much that can go wrong on a single instance with a local database. Have a failover in case the HW fails and you are good to go, and it's faster. The pricing is not great, but perhaps that's something GitLab can solve. But being hip and being lean (even if it costs more) is more important I guess.
- nik736 9y agoDid you actually notice that BitBucket was down yesterday for several hours and still has huge issues?
- zbentley 9y agoI think GP was referring to the fact that bitbucket.org-the-website is just the Atlassian-hosted installation of BitBucket-the-Atlassian-product, which you can also self-host and self-administrate. It is payware, but reasonably affordable ($10/10 users, usually). I've seen companies squeeze some (probably contract-breaching) huge numbers of users out of the very small plans of Atlassian software, as well, usually via insane multiple-people-using-same-account editing conventions.
- stephenr 9y ago> to the fact that bitbucket.org-the-website is just the Atlassian-hosted installation of BitBucket-the-Atlassian-product, which you can also self-host and self-administrate. Nope. They're completely separate things. The hosted one they bought, and does mercurial too. The self hosted one is what used to be called stash, and is git only afaik.
- dx034 9y agoIsn't Gitlab at least as hip as Github?
- apple4ever 9y ago
- james33 9y agoIs it just me or is the new GitHub Status page a joke? It used to show historical charts for uptime and latency for each of the different services, which was actually useful. Now it is just a daily messages list.
- anowlcalledjosh 9y agoYes, I noticed that too. I wonder when the charts got removed.
- jamessb 9y agoThe Wayback Machine suggests it was 13th September 2017: [1] (from 17:50:53 GMT) has graphs, but [2] (from 20:06:33 GMT) is a 302 redirect to the messages page. [1]: https://web.archive.org/web/20170913175053/https://status.github.com/ https://web.archive.org/web/20170913175053/https://status.gi... [2]: https://web.archive.org/web/20170913200633/https://status.github.com/ https://web.archive.org/web/20170913200633/https://status.gi...
- pandemic_region 9y agoalready looking forward to the post-mortem on this one :)
- bunderbunder 9y agoBack when hurricane Sandy took out my employer's upstream Mercurial server for several days straight, I was pretty chuffed to be able to tell my boss, "You know how we migrated to a new source control system a couple months ago? Well, thanks to that, we can keep working pretty much uninterrupted. We should double check that XXX is getting frequent offsite backups, though." My current company uses a self-hosted option, so this doesn't affect me. But I can't help but think that this time it's different, and we'd be hosed. The git part would still work without too much hassle, but we are heavily dependent on a bunch of additional things that GitHub offers, such as the pull request interface. That's slightly worrisome, I suppose. All that said, I want to steer clear of knee-jerk assuming, "We don't have this problem b/c we self-host." There's a sickening sense of not really being in control of your own fate when a cloud provider goes down, but, realistically, I wouldn't be the person in charge of getting one of our self-hosted services back up, either. What really matters is % downtime. My experience has been that, compared to many in-house IT departments, folks like GitHub are generally very good at keeping the lights on.
- Klathmon 9y agoWhile I don't necessarily agree with it, the argument is that with a self hosted solution, you have more control over when you are doing things. So if you have a really busy time coming up, you don't deploy the new git update that day, you wait until you would be okay with some downtime.
- deleted 9y ago[deleted]
- MrBingley 9y agoShould be the name of a movie. "How will the world's hackers react when their source code goes offline? GitHub Down, watch it now!"
- JdeBP 9y agoWe know how they react. It's the same reaction as when their chat rooms go off-line. (-: * https://news.ycombinator.com/item?id=16109735 https://news.ycombinator.com/item?id=16109735
- deleted 9y ago[deleted]
- romanovcode 9y agoAgain, the GitHub is down for 5 minutes and everyone rushes the "who will post first on HN" thing. I don't get it.
- zbentley 9y agoFake Internet Points at stake + a lot of engineers sitting around with nothing to do = spam HN.
- bigsassy 9y agoIt's back up for me.
- phyller 9y agoLooks like it is back up
- sdruskat 9y agoAaaand it's back.
- dx034 9y agoAnd we're back
- jacksmith21006 9y agoWhere is GitHub hosted?
- coding123 9y agoI think it's back up.
- ryanpcmcquen 9y agoThis is why I mirror all my GitHub repos with GitLab. Redundancy FTW.
- naiveai 9y agoBack up now!
- musicmatze 9y agoReposting this (https://news.ycombinator.com/item?id=16124702 https://news.ycombinator.com/item?id=16124702) as top-level comment, because I think it is worth it: The git-dit project (https://github.com/neithernut/git-dit https://github.com/neithernut/git-dit) provides a distributed issue tracking functionality inside git. It does this without cluttering the repository with unneeded files, gives the possibility for having tree-like conversation (including merging conversations), referencing issues, linking to commits and so on. It is even possible to host the issues in another repository as the code (if that is wanted) or having one repository of issues for several projects / moving issues from one repository to another. There is only a CLI as of today. I hear that there is some effort on building a (view-only) web frontend for it, though I don't know much about its progress. Maybe asking the maintainer would be an idea. What's also missing is a way to give users of the tool access to a repository where they can submit issues (which then could also be used by a web/gui frontend for the tool). This is not the domain of git-dit itself, but a solution needs to be found. One idea would be a publish repo (where everyone can push) which automatically does some sanity-verification on the issues and forwards them to the maintainers repository... or something like that. Also integration/mappers to/from other services (gitlab, github) are missing and so is mail->git-dit integration (posting issues from a mailinglist automagically into the issues repository). Also, https://github.com/vitiral/artifact/ https://github.com/vitiral/artifact/ is a really nice tool to do planning of an application or library inside a git repository. I am currently starting using it in imag (https://imag-pim.org https://imag-pim.org) and it is really wonderful. The author currently does a reimplementation of its core functionality to make it even more powerful.
- josephfrazier 9y agoMore generally, here's one of the best discussions of distributed issue tracking I've found (dated 2013): http://travisbrown.ca/blog.html#TooMuchAboutDistributedBugTracking2013-04-20 http://travisbrown.ca/blog.html#TooMuchAboutDistributedBugTr...
- scott_karana 9y agoSelf-hosted vs SaaS is not a binary decision, and I hate seeing it argued like that every time there's an outage. What the hell happened to basic risk mitigation? Offsite backups, disaster procedures, etc aren't new, or unexpected. You'd think they should be the norm, if you're a working professional...