12 ms·
GitHub was down
- ramnique 6y ago+1 down in India
- tony-allan 6y agoWe had issues producing the response to your request. Sorry about that. Please try refreshing and contact us if the problem persists. Contact Support — GitHub Status — @githubstatus
- Yarduza 6y agoThe prophecy, it's starting...
- soulchild37 6y agoMonday blues...
- coronadisaster 6y agoworks for me... loaded this file no problem: https://github.com/washingtonpost/data-police-shootings/blob/master/fatal-police-shootings-data.csv https://github.com/washingtonpost/data-police-shootings/blob...
- erkanerol 6y agoUnicorn!
- agustif 6y agoC'mon microsoft GH is down it's becoming a weekly trend here on HN..
- gear54rus 6y agoinb4 PR strategy
- dx034 6y agoAfter Facebook bought Whatsapp it also started having outages at a scale never seen before. Whatsapp used to be a service that was practically never down, after the acquisitions it sometimes had outages of up to a day. Rumours were that it was related to features that FB wanted to add (e.g. video chat). Maybe there's something similar at play here, that Github integrates MSFT services without proper testing?
- sbahr001 6y agoIt feels like this is happening a lot more(since quarantine) . It's really weird for how big this company is, how important, and have microsoft's backing. It is a little concerning given how much my work depends on its stability.
- oars 6y agoFirst time I've ever seen it down, I guess there's a first for everything. Now I understand why many people are very paranoid when it comes to taking backups. Is it worth backing up my GitHub repos somewhere else? What do other people use as an alternative source of truth for their code?
- huseyinkeles 6y agoNot sure if you were being sarcastic but Github goes down quite often :) https://hn.algolia.com/?q=github+down https://hn.algolia.com/?q=github+down
- s9w 6y agoI think this implied that it never was down for him before when it was reported to be down. Which is exactly my experience, too. I've seen a lot of GH down posts here - it never was for me. Now it's the same.
- arghwhat 6y agoPossibly region/cluster specific? Not loading for me from Denmark.
- sbahr001 6y agohttps://downdetector.com/status/github/archive/2020/06 https://downdetector.com/status/github/archive/2020/06, This verifies your data as well, but if you look at the data from Jan '20 to July '19(massive issues in july), there have been more outages. Keep in mind that the stats don't include small outages that last upwards of 2 mins or are region specific. My team and I have been encountering a lot of two min or less kind(usually fixes on a refresh 10 seconds latter). It gets annoying after a while. Its weird given that github hasn't adjusted to quarantine effect.
- arghwhat 6y agoGitHub is down all the god damn time. At this point, I consider it the least reliable hosting service available. But, to be fair, it's also the one with the most traffic.
- Lapz 6y agoIts back up for me
- pbexe 6y agoIt's back up for me now
- h0ek 6y agoLooks like something went wrong!
- colinbartlett 6y agoIf you’re wondering if GitHub has been down more since the Microsoft acquisition, I actually just recently did some analysis on that using their status page data (the answer is yes): https://nimbleindustries.io/2020/06/04/has-github-been-down-more-since-its-acquisition-by-microsoft/ https://nimbleindustries.io/2020/06/04/has-github-been-down-...
- tempay 6y agoIt's not surprising. I don't have any data to prove it but it feels like they're shipping improvements and new features at a much faster rate.
- stupidcar 6y agoOr it could be some of the older employees decided to cash out after the acquisition, and they've lost some institutional knowledge about how to keep things running smoothly?
- user5994461 6y agoThe addition of interns and new members typically cause more outages, as they make a lot of changes and discover how things work or not. Retaining older employees has little effect to prevent that, because they typically don't/can't review much of what's happening from a new team, sometimes a whole department, who joined in on the project and has its own agenda.
- sammorrowdrums 6y agoI was just thinking that Github stayed fairly consistent and Bitbucket didn't really challenge it on features, and then Gitlab came in, shipped loads of popular features and lots of CI functionality, and Github has been delivering a lot of new features a lot faster ever since really, so I think Microsoft acquisition is quite possibly not a root cause of downtime changes. It's also worth noting that downtime and issues caused during updates in self-hosted Github are significant. I have experienced them, and I guess the main difference is actually that you can schedule the risk, rather than accept it arbitrarily which has positives but comes at significant cost too.
- jonny383 6y agoSounds like a good time to run something like this https://github.com/clockfort/GitHub-Backup https://github.com/clockfort/GitHub-Backup
- pantalaimon 6y agoGit itself is not the issue - the problem is Review Comments, Pull requests and issues.
- coronadisaster 6y agoAre you saying that Git should implement those features?
- deleted 6y ago[deleted]
- pantalaimon 6y agoThat would be pretty neat.
- realusername 6y agoHaving data outside of the repo is pretty strange in itself, that breaks the federated approach of git.
- dx034 6y agoAs few people seem to use Git without those features it would probably be a good idea. Git isn't really decentralized if large parts of the workflow are vendor specific and not cloned.
- foldr 6y agoI'm not sure how active Linus still is in git development, but at least historically, the issue there is that the Linux kernel dev workflow doesn't use any of those features.
- rvz 6y agoAgain? This is like the fourth time GitHub went down. Last time this happened was almost a week ago. [0] Seriously, just consider self-hosting [1] rather than 'centralizing everything' [2] [0] https://news.ycombinator.com/item?id=23604944 https://news.ycombinator.com/item?id=23604944 [1] https://news.ycombinator.com/item?id=23572532 https://news.ycombinator.com/item?id=23572532 [2] https://news.ycombinator.com/item?id=22867803 https://news.ycombinator.com/item?id=22867803
- dx034 6y agoI set up a self hosted Gitlab where on-prem was a requirement and it's surprisingly easy. Obviously another service that needs to be maintained and updated but as code repositories and connected services are a crucial part of infrastructure it makes sense to have control over that. Not the biggest fan of Gitlabs UI but I got used to it quickly.
- dna_polymerase 6y ago> Not the biggest fan of Gitlabs UI but I got used to it quickly. It gets more attractive now that GitHub starts changing theirs. Might as well adapt to GitLab now.
- rplnt 6y agoYou can self host github or bitbucket as well, but it does get expensive.
- passthejoe 6y agoThere's always https://gitea.io https://gitea.io, the self-hosted Git server project that powers https://codeberg.org/ https://codeberg.org/
- 87zuhjkas 6y agoOr live with it and list GitHub downtimes as one of your business risks.
- darkwater 6y ago
- erikig 6y agoSo many services rely on github that it has become a single point of failure for online infrastructure as we’ve come to know it. I remember seeing this shared many years ago [1] and not much seems to have changed in the interim. If anything the MS acquisition has only exacerbated matters. [1] https://www.brandonsavage.net/github-your-single-point-of-failure/ https://www.brandonsavage.net/github-your-single-point-of-fa...
- Puts 6y agoIf you let Github become a single point of failure, maybe you are using git wrong? It's named "Distributed version-control" for a reason. I can really recommend this talk by Linus Torvalds about how git is more of a way of working than a piece of software: https://www.youtube.com/watch?v=4XpnKHJAok8 https://www.youtube.com/watch?v=4XpnKHJAok8
- kasey_junk 6y agoThe git aspects of github are not the things people build SPOF on. It’s the code review tooling, the artifact storage & the deployment pipelines. A distributed version of those would be awesome...
- yingbo 6y agoI may use git wrong, but didn't use GitHub wrong. First, Github provides more functions than a git repo. Second, I haven't seen anyone or any company using Git in the way as Linus said in the video. I believe most companies are not either.
- rurban 6y agoI'm using git bug, so I don't care at all about some delays to sync my issues. I'm not using GH actions, only Cirrus, Travis and Appveyor, which can be triggered manually if the API service is down also. https://github.com/MichaelMure/git-bug https://github.com/MichaelMure/git-bug
- navanchauhan 6y ago> Gitlab is written on Ruby on Rails; you should understand the security implications of Ruby on Rails before using Gitlab Can someone ELI5 the security implications of Ruby on Rails?
- Santosh83 6y agoGitHub Pages seems to be up though. My website is still online.
- mcintyre1994 6y agoI'm guessing the core functionality of Pages is quite isolated from the rest of the site since it's just serving static sites over a CDN.
- dry_soup 6y agoIn the OP you can see that GH pages are currently the only service that is not broken
- developuh 6y agoHas anyone here tried self hosting Phabricator? Some of our private repos are Mercurial so it would be nice to have both git and hg repos on a single platform.
- fart32 6y agoYears ago, it was too complex for me. I recently switched to Gogs and I'm satisfied with that. But that's Git only.
- developuh 6y agoThanks. I need something that can handle our hg repos.
- wilsonthewhale 6y agoSourcehut (hg.sr.ht) is supports Mercurial and can also be self-hosted. Not sure how complicated it is to do so.
- workethics 6y agoKallithea[0] has support for both. You might want to test it out and see if it's a good fit for your setup. I enjoyed working with it when when I used it. [0]https://kallithea-scm.org/ https://kallithea-scm.org/
- YetAnotherNick 6y ago99.95% SLA means less than 66 minutes of downtime is acceptable per quarter. I guess they will be offering credits to enterprise customers this time for the first time. Edit: Correct a mistake but the time calculated is correct.
- dubbel 6y ago99.95% that is. Source: https://help.github.com/en/github/site-policy/github-enterprise-cloud-addendum#enterprise-cloud-uptime-sla https://help.github.com/en/github/site-policy/github-enterpr...
- Nemo_bis 6y agoNice. I hope GitHub is down 67 minutes every quarter, just so that Microsoft loses some money.
- aparsons 6y agoYou must have a fulfilling life with lots of friends
- iamdual 6y agoI hate Microsoft. I've seen a lot of unicorn lately.
- deleted 6y ago[deleted]
- iamdual 6y agoI love downvotes.
- rawoke083600 6y agoAg nee ouens !
- pnako 6y agoCan we make this thread a sticky?
- st_goliath 6y agoBrowsing through the status page makes me wonder how they manage to have issues like this so frequently. Are there publicly available post-mortems for previous incidents? From a first glance I can't find any on the status page. Having an electronics engineering background, my personal pet theory is that the convoluted layers upon layers of automagic container management, load balancing and scaling mechanisms act like nested control loops in respect to each other and sudden load increases (e.g. Monday morning load spike) cause the system to essentially produce a step response and it starts overshooting/oscillating. Just a thought tough.
- jlgaddis 6y agoEarlier this year, they were blaming several of the outages on "the database". Not sure if that's still their scapegoat or if they've come up with a new one.
- protomyth 6y agoWell, at least Microsoft hasn't had a Sidekick like event happen to GitHub. https://en.m.wikipedia.org/wiki/2009_Sidekick_data_loss https://en.m.wikipedia.org/wiki/2009_Sidekick_data_loss
- lowskillblake 6y agoLast night on home laptop I wrote some code, put it in a private gist and went to bed. Came to office at 4:30 AM to work on my own project before work day start. GUESS WAT !!! GitHub down ... FML
- corytheboyd 6y agoIt drives me insane that they don’t localize the times on their status page, is there a real reason they are displayed as UTC? If you are looking at a status page chances are anxiety is already high, to throw time zone conversion into the mix too is just obnoxious.
- johnkpaul 6y agoSince turning on resist fingerprinting in Firefox, I am totally used to this problem. I have now memorized and automatically do the timezone math in my head. Sadly I don't have a real solution for you but at least I have an option that means it's all consistent! :-D
- jlgaddis 6y agoI'm the exact opposite. I hate it when sites use their local time, instead of just using UTC everywhere. I got accustomed to using UTC ~25 years ago. At worst, it'll take you two seconds to open up a terminal and run $ date -u if you can't handle the conversion "internally".