13 ms·
Incident with Github.com [resolved]
Just got this message: "No server is currently available to service your request. Sorry about that. Please try refreshing and contact us if the problem persists."
Edit: at the time of posting there was not an incident on githubstatus.com. Now there is. https://www.githubstatus.com/incidents/zkxwbgr0cnmx
Original Title: "Tell HN: GitHub Is Overloaded"
- grilledchickenw 2mo agoYep, started with PR changes not being visible, but now can't load entire repos. I see the pink unicorn.
- thelastgallon 2mo agoDid they switch to Azure?
- datadrivenangel 2mo agoThey've been moving to it, which is likely part of the problem.
- dumidusw 2mo agoyes as they say they do it in order to power resource-heavy, next-generation AI workflows like GitHub Copilot and autonomous agentic developer tools
- ozarkerD 2mo agoIs github down? Does the day end in y?
- Hammerhead12321 2mo agoNo, es lunes.
- ozarkerD 2mo agoDamn. Wonder why it's not working then
- SigmundurM 2mo agoSame here. Just as I was going to push out a release
- MallocVoidstar 2mo agohttps://www.githubstatus.com/ https://www.githubstatus.com/ It's all green which means it's working. Ignore the unicorn error on every page. edit: After 5-10 minutes they got around to opening an incident and (apparently manually?) marking the API as having 'degraded performance'.
- cyphar 2mo agoI find it quite amusing what they seem to consider "degraded performance" to mean -- I guess if you really squint, your service not working at all is actually just very large latency spikes (until the service recovers) and thus can be labelled as "services experiencing degraded performance for a small portion of our customers".
- malfist 2mo agoEven better "degraded performance" doesn't seem to count against their uptime stats. Issues is labeled as "degraded" with 100% uptime.
- bemcho 2mo agoyes in Bulgaria
- jjice 2mo agoI'm seeing "Merge status cannot be loaded" when attempting to merge a PR. It's a shame I had to go to HN to check if I was the only one instead of relying on their status page that they link.
- Andugal 2mo agoYes it is https://downdetector.com/status/github/ https://downdetector.com/status/github/
- asdfasdfasdf49 2mo agoI'm experiencing as well.
- lol768 2mo agoIssues seems to be completely broken, just getting unicorns. Interestingly the API still works for creating an issue (but webhooks weren't fired).
- lini 2mo agoincident was just created - https://www.githubstatus.com/incidents/zkxwbgr0cnmx https://www.githubstatus.com/incidents/zkxwbgr0cnmx
- macintux 2mo agoHey, only 8 hours from open to close. What's all the complaining about? (I know, I know, no sarcasm here, but sometimes it feels necessary.)
- root-parent 2mo agoAs sure as it is Monday....
- Maxion 2mo agoWelp, workday over in Europe early!
- zeafoamrun 2mo agoWho are you kidding, nobody has been in since the start of August!
- SideburnsOfDoom 2mo agoYep. Github issues mostly hit when it's morning in the USA and that load comes online. i.e. afternoon in UK and Europe.
- augustohp 2mo agoOn the bright side, they were pretty fast on the Incident Declaration this time.
- khvn26 2mo agoI had a lot of goodwill for GitHub but I think today is the tipping point. Looking at a unicorn page, I feel this lingering hope that it's transient (like it usually was in the old days) but my mind reassures me it's probably going to be a long full outage again. The hope is dead.
- stingraycharles 2mo agoI’m willing to give them a break as I’m assuming they have a lot of scaling problems due to the influx of LLM assisted coding. But maybe I’m wrong?
- benrutter 2mo agoI'm really curious how other codeforges are faring. I only use codeberg and github - codeberg seems to have less outages, especially for a much smaller organisation, but they've recently removed support for LLM projects which could be linked. Anyone here have data on whether the likes of gitlab have been impacted in the same was as github?
- sznio 2mo agomy personal forgejo instance has had 100% availability for the last two years.
- beardedetim 2mo agoWe're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" No idea if/when we decide to pull that bandaid but I think once we can't merge a hot fix into main because of GH being down, it'll be a big org push to replace it. What's everyone else using? Self hosted Gitlab? Gitea?
- drno123 2mo agoSelf hosted Gitea
- newswasboring 2mo agoWhen you self host, what happens with your compute costs? CI can be super expensive depending upon your test pipeline. Do you end up spending more than you would with GitHub actions for example?
- Maxion 2mo agoHuh? The VPS boxes have a fixed monthly fee
- applidhumanco 2mo agoHe is likely referring to the CI runners. Gitea has their own version of Actions runner. It is very much usable, though currently inferior to GitHub Actions (not always a 1:1 replacement, even though they aim for it to be): https://docs.gitea.com/usage/actions/ https://docs.gitea.com/usage/actions/ Cost as always depends on your usage, but it will likely be less than your current cost of GitHub Actions.
- newswasboring 2mo agoThank you. This is exactly what I meant. I work for a large company where our testing budget is massive and most of it goes towards these CI runners. Provisioning enough and consistent compute for testing pipelines sometimes becomes the bane of my existence.
- pedroigor91 2mo agoyes in Brazil
- xet7 2mo ago1) Issues showed unicorn. Reloading page. 2) Issues showed Not found. Anyway, GitHub Actions for building new release has progress. Good enough.
- biennvops 2mo agoSeems to affect web as well. Currently working on a PR and now it says "Merge status cannot be loaded"
- dhruv3006 2mo agohow long can they survive like this?
- datakan 2mo agoMicrosoft has thrived like this for 40 years
- yndoendo 2mo agoAs the saying goes, 'No one gets fired for choosing Microsoft solutions'. I've talked to a number people in IT and commonly found they use Linux or Mac at home, as their daily, and Windows only at work. Talking one of the IT works in the company I work for, they were forced to move from GitLab to GitHub because the CTO wants Microsoft everywhere. When all you know are screwdrivers, a personal will gladly use them as a hammer, punch, .... Back in my IT days, we were pushing for marbled solutions. Example, 50% of the computers have antivirus brand Y and 50% have antivirus brand Z. Or the Windows servers used a different antivirus solution than the desktop. I don't see this anymore in the industry. One basket and all eggs go inside. Irony, I'm updating code so our main products no longer require Windows as the host OS. You have to pay me to use Microsoft products and solutions.
- brookst 2mo agoIt's getting to where we should just post when it's working fine, to reduce noise.
- AdyanshG 2mo agoWhich AI model is it this time?
- qsera 2mo agoYes, in India.
- phatfish 2mo agoIf you are required to use a Microsoft tool is Azure DevOps now a better choice? Our Azure hosted instance rarely (if ever) has had an outage that effects our ability to work.
- chilmers 2mo agoThe worry I would have is, is anybody at MS still working on it? It is barely updated anymore: https://azure.microsoft.com/en-us/updates?filters=%5B%22Azure+DevOps%22%5D https://azure.microsoft.com/en-us/updates?filters=%5B%22Azur... That's not necessarily a bad thing for stability, but long-term I would not be surprised if it gets EOL-ed, or radically shrunk to just a basic Git mirroring service.
- phatfish 2mo agoI'm not sure that link is a fair representation of the updates. This has more detail https://learn.microsoft.com/en-gb/azure/devops/release-notes/features-timeline-released https://learn.microsoft.com/en-gb/azure/devops/release-notes... Discussion about it going ELO has been around since 2020-ish. But that is a worry i agree. I get the feeling there is a long tail of old-school corps (migrated from the TFS days) that will keep the lights on. And for some orgs you just need "good enough" CI/CD pipelines that are reliable. Maybe I'm a weirdo, but i find the kanban/sprint board pretty usable as well.
- lionkor 2mo agoAs someone who maintained a product that was, until recently, on Azure DevOps, stay away. Like, really really far away. There's nothing positive I can say about it.
- aleksandrm 2mo agoCan anyone shed some light why GitHub is having so many problems lately?
- allanmacgregor 2mo agoIts all vibes man
- biennvops 2mo agoTotally not because of their movements to Azure.
- cybrox 2mo agoThat certainly doesn't help but I'd imagine their traffic in general spiked massively with agentic interactions as well?
- Retr0id 2mo agoI think the most charitable theory is that they're seeing rapidly growing usage (more users churning out higher volumes of code, via LLMs), and are struggling to scale to meet demand. Alternative theories include "azure sucks" and "they're vibecoding everything now".
- dtech 2mo agoThey say it's the skyrocketing load because of AI tooling Many people suspect it's the year-long migrating to Azure and all their products instead of the things they have been using.
- thinkingtoilet 2mo agoMicrosoft simply can not make software anymore. I worked at S&P Global and when you work at a global-mega corp, you quickly see why they lose the ability to create anything and just acquire companies to grow.
- everfrustrated 2mo agoLately? GitHub has always been bad with downtime. It hasnt got worse just more visible as people do more CI now than before.
- rvz 2mo agoAs I said 4 days ago GitHub is in chronic operational decline which is killing trust in hosting repositories [0] You can use as many AI agents as you want (it won’t solve the problem), but with that many outages ever since getting bought by Microsoft, it is more than enough time to give them to change. They don’t care and there is no CEO of GitHub to help either. A self hosted instance would have much better uptime than GitHub and GitHub Actions at this point as I predicted 6 years ago. [1] [0] https://news.ycombinator.com/item?id=49276571 https://news.ycombinator.com/item?id=49276571 [1] https://news.ycombinator.com/item?id=22867803 https://news.ycombinator.com/item?id=22867803
- pavo-etc 2mo ago> Update - We are seeing an approximate 20% error rate across numerous experiences including Pull Requests, Issues, and others. Investigations are currently under way and we will be posting updates as they become available brutal
- gottagocode 2mo ago20%, do we just make numbers up?
- ozarkerD 2mo agoDepends if this is coming from engineering or management
- deleted 2mo ago[deleted]
- anonymousab 2mo agoIt seems vastly higher on every region and VPN I've tested, so I think this is a case of the "technicalies". It is technically 20%, because a bunch of the requests that happen on page load do succeed. Just not the few crucial ones that are required for the page to load correctly - those return a 500 the vast supermajority of the time.
- brookst 2mo agoI can't get a single PR or issue to work. Maybe it's "20% globally, 100% anywhere people are awake".
- malfist 2mo agoFeel free to disregard this because ultimately its a tangent that doesn't matter; but supermajority is specifically a political term referring to the required threshold to advance legislation when simple majority isn't procedurally enough. It doesn't mean simply a greater share of.a majority
- ArcHound 2mo ago[dead]
- blinky88 2mo agoThis is getting ridiculous. Issues, PRs, actions... nothing's working
- biennvops 2mo agoInterestingly enough if you access the PR number directly it still works.
- imstil3earning 2mo agoBut the `Files changed` tab still 500's so the direct PR link is not worth much
- majewsky 2mo agoNot for me.
- Maxion 2mo agoProbably cached data and the listing search is not?
- orangeisthe 2mo agogh CLI works for me
- duxup 2mo agoNot for me. Unicorn error.
- peri-cl 2mo agoAh, so that's what the agent meant by summarizing a documentation page as "Unicorn!" I'd thought it was a very colorful hallucination (it's just GitHub's (unicorn-themed) failure page). Gathered details on embedding request syntax from Unicorn! · GitHub I was querying docs to figure out how to set up RAG to query docs locally. Alas.
- abluecloud 2mo agoi'm surprised the agent didn't take into consideration the http status code
- gentlewater 2mo agoWhat’s the code for http unicorn? /s
- arccy 2mo agoThere's one for a teapot, surely there can be one for a unicorn
- esskay 2mo agoGithubs a great advert as to why you shouldn't use Azure. What an utter mess its become since they took over. Their argument that its scaling issues due to increased traffic just makes them and Azure look incompetent.
- MrFurious 2mo agoOh, shit, here we go again...
- deleted 2mo ago[deleted]
- allanmacgregor 2mo agoSo whats the alternative? I'm thinking I'll migrate my company to something self hosted, but what about personal projects?
- warmwaffles 2mo agoFor your personal projects, do they _need_ to be on a remote git server with a full GUI?
- tempaccount420 2mo agoWhy haven't we all moved off GitHub yet? Or let me ask a more useful question: if we were to move, then to where? Ideally somewhere new (not Gitlab)
- mrkaye97 2mo agoI think the clear reason is even with their unreliability, the cost of migrating off of GitHub for _most_ places is not worth it, and so companies don't / won't (yet)
- ArcHound 2mo agoThis bugs me so much. Management decides what is reasonable cost of service and the employees have to deal with all bullshit coming from that product. And you can't really escape it. Maybe the real moat was enterprise deals we made along the way.
- mrkaye97 2mo agoCould be - I’d also argue the time cost to the engineers to switch is pretty significant too, regardless of the monetary cost
- ndriscoll 2mo agoIdeally something like IPNS to have a mutable ref based on (repo, pubkey, branch) to resolve a commit hash, a DHT for who has what commit hashes, and then just p2p transfers. You could still have a github or gitlab for issues and CI, but code (and maybe issues) could all be p2p like git is already designed for. Your forge could also act as a peer for code cloning, of course.
- bhouston 2mo agoI do not need it to be meaningfully different than Github, it sounds like that introduces additional complexity. I just want Github that works.
- leumon 2mo agoNot sure if related, but claude seems to be down for me too.
- bhouston 2mo agoIt is not working at all, I can not load any repo pages. Github.com's promise is that it can be the central broker of open source code because it is reliable. That promise hasn't been kept recently. That said, Github is hard to displace and it is similar to the era of the Twitter Fail Whales. It was a sign of growth that couldn't be properly managed but there was not viable alternative.
- hedgehog 2mo agoIt's a bit of a different situation though, in many cases the unit of adoption is a team or organization that is free to switch platforms without consideration of what anyone else is doing. At this point I'm going to move my personal projects, it's not bad enough to be a priority at work yet but it's trending that way.
- jillesvangurp 2mo ago> Github is hard to displace and it is similar to the era of the Twitter Fail Whales Hard but not impossible. Being unreliable might nudge a few people. Also, Twitter had their fail whale in their early phase (mostly), not twenty years or so into their existence. The issue with replacing Github is that it takes more than version control and issue tracking to replace the network that is Github. It's effectively the largest social network for software developers on this planet. Tangled (tangled.org) is built on the at protocol (bluesky) and seems like an interesting take on this. Most other solutions seem to just move the problem to another much smaller silo (gitlab, codeberg, etc) or throw out the baby with the bathwater by focusing on self hosting without attempt at networking with other instances. A federated approach seems like it is directionally right. Tangled is far from feature complete but I like the direction and it probably is a bit more resilient against global outages like this. I'm not a user yet but I'm keeping an eye on it.
- palata 2mo ago> throw out the baby with the bathwater by focusing on self hosting without attempt at networking with other instances May I ask what networking with other instances brings? Git is decentralised, so it works with self-hosted instances, right?
- stetrain 2mo agogithubstatus.com has been updated with an incident now: > Update - We are seeing an approximate 20% error rate across numerous experiences including Pull Requests, Issues, and others. Investigations are currently under way and we will be posting updates as they become available Aug 17, 2026 - 13:45 UTC
- arccy 2mo agoexperiences, as if we're in disneyland
- c-hendricks 2mo agoIt sounds like what I was seeing when trying to view PRs last night, so it started almost 12 hours ago.
- JoshStrobl 2mo agoSo glad I moved my OSS org mostly over to a self-hosted Forgejo + Woodpecker CI. I get that we are operating on a completely different scale but I swear the GitHub outages are far too regular than they ought to be.
- Maxion 2mo ago> We are seeing an approximate 20% error rate across numerous experiences including Pull Requests, Issues, and others. Investigations are currently under way and we will be posting updates as they become available Well it's 100% down for me, so does this mean 20% of all users are fully down?
- lionkor 2mo agoIt means it doesn't count towards their uptime at all, I guess, because all their uptime stats are very high for a service that is down more than anything else I use
- Maxion 2mo ago> Pull Requests is experiencing degraded performance. We are continuing to investigate. > Posted 1 minute ago. Aug 17, 2026 - 13:58 UTC It also took them 20 minutes to realize that peoples requests to /pull/xx are not working :D
- xnorswap 2mo agoIf you load an issue page, you'll see 1 failed request to: /project/product/issues/<number> And sure, that's what you care about, but consider the working requests to: /in-product-messaging/copilot-budget-request-banner /in-product-messaging/code-scanning-ai-findings-preview-banner /github-copilot/chat /_private/browser/stats See, only 20% requests failed!
- chromehearts 2mo agoAnd I just wondered why I couldn't update my nix flake lol
- ape4 2mo agoWill our hug of death now make githubstatus.com crash
- layer8 2mo agoI was vaguely remembering that there’s http://githubstatusstatus.com http://githubstatusstatus.com, but it isn’t very helpful unfortunately.
- deleted 2mo ago[deleted]
- mikert89 2mo ago[flagged]
- Nextgrid 2mo agoDon't worry, they are also working hard at destroying those products too.
- webel0 2mo agoI object to the notion that having "american born engineers" is the cause of their issues.
- eddieroger 2mo agoYeah, that was unnecessary. Incompetent are born and work everywhere. In this case, Microsoft's problem with GitHub is trying to shove the square peg that is GitHub in to the round hole that is Azure.
- TremendousJudge 2mo agoI have worked with some "american born engineers" that were some of the least competent people I've ever seen, while getting paid 2x or 3x of some "foreign contractors" on the same team
- noosphr 2mo agoWe may as well call them working hostages.
- Nextgrid 2mo agoIt ain't the cause, but is definitely an enabler, because foreign talent on work visas effectively depends on their job much more so than their domestic counterparts and are thus very unlikely to push back against unreasonable demands or workload.
- geraneum 2mo agoI don’t watch sitcoms anymore. I come read HN for these gems.
- r_blake 2mo ago[dead]
- anoplus 2mo agoHow did Github become so famous for outages? It is almost like a routine. I haven't used other code repo hosting / CI/CD pipelines platform for last decade, so maybe it's just the nature of this business, I don't know.
- vanillax 2mo agoBy switching to Azure....
- forestry 2mo agoDo you have some information that it’s Azure related that isn’t public?
- zipy124 2mo agoit seems to be coinciding with teams and other microsoft services having issues would be some indication, but some other non microsoft products are also having a bit of a spike too. NB: I am not OP but just providing some context as to why they might think this.
- vanillax 2mo ago[flagged]
- jemiluv8 2mo agoAwwww maaaan. I was just reading an upstream patch on the erpnext framework. I was going to do their copy the pr to patch my erpnext v15
- hn58622tsf 2mo agoBeen doing this wrong for years, thanks
- melezhik 2mo agoIf someone needs lightweight self hosted git server with ci pipelines via general programming languages - consider DSCI - http://deadsimpleci.sparrowhub.io http://deadsimpleci.sparrowhub.io
- Arubis 2mo agoThis is starting to feel like Twitter. For a variety of reasons, we had a centralized place where everyone of a particular set of persuasions could connect, and this had outsize benefits for the community as a whole. That place is becoming untenable, and with the loss of goodwill and stability, the community’s started to dissipate. But there isn’t one obvious transition candidate, so the diaspora is finding itself spread across a bunch of disparate places and services. The stated need they satisfy (source control with a web interface and some technical features, like pull requests with reviews) will be fulfilled. But those emergent features like a core community and default expectation of where you can find someone will fade. And that is a very real loss for all of us.
- noosphr 2mo agoLuckily we already have a distributed version control system that can take over github: https://fossil-scm.org/home/doc/trunk/www/index.wiki https://fossil-scm.org/home/doc/trunk/www/index.wiki I suppose people can use git too if they ever figure out how to send emails from a dedicated client.
- AlexandrB 2mo ago> Luckily we already have a distributed version control system that can take over github Surprised that this wasn't just a link to Git. The biggest benefit of Git over predecessors was that it enabled decentralization. Github re-centralized the common case for the sake of convenience.
- jeremyjh 2mo agoYes but on Earth every project needs a canonical main branch. Most also need a way to manage and review changes to that branch that all project members have direct access to.
- Sanzig 2mo agoGitea (and its popular fork, Forgejo) are very lightweight. You can easily stand up an instance on a cheap VPS.
- ieie3366 2mo agoTo everyone who is angry: calm down. Github’s servers are constantly on fire as their usage increased something like 50x due to LLM sloppers pushing large amounts of trash code Unless you have a emergency hotfix (you don’t), go hit the gym or walk outside. If a work tool going down triggers you enough mentally to start angrily ranting online, it’s a sign you need to chill out and focus more on your health
- kilroy123 2mo agoAs a _paying_ customer, I disagree.
- mococa 2mo ago> increased something like 50x due to LLM This should not be an excuse since they probably can use AI to fix it /partially sarcasm
- eddieroger 2mo agoFor the amount of money enterprises are paying to GitHub, there is a reasonable (and contractual) expectation of uptime. I don't think my boss would find it to fun if I bailed work to hit the gym just because GitHub was down.
- deleted 2mo ago[deleted]
- iamcoder18 2mo agoYes, but GitHub enterprise has different uptime (https://us.githubstatus.com/posts/dashboard https://us.githubstatus.com/posts/dashboard) and actually does have an SLA. Edit: it seems GHE is also affected by the outage and isn't much better.
- twistedpair 2mo agoSince upgrading to Cloud Enterprise... why didn't my GH uptime get any better? Guess on-prem GHE server is the only way to do that.
- zeroq 2mo agoIt's been a downward spiral since covid. Enterprise works ok-ish, but the standard version has daily issue ever since.
- esskay 2mo agoNot sure covid was the sole driving force. A combination of MS taking over and deciding to move it to Azure, a massive increase in traffic due to ai usage (not that this should be an excuse for a platform that should be scaleable), and Github going all in on AI usage to write its own code. They're making it very easy for a viable alternative to pop up and take their lunch - it just wont be Gitlab.
- csvance 2mo agoWhile it annoys me how things have gone downhill, I think you missing one key detail with regards to competition. It's only "very easy" if you feel like throwing enough money at CI compute to power the majority of the open source ecosystems needs. That would be the bare minimum in order to even have a shot of achieving similar levels of network effects as Github.
- macNchz 2mo agoI don't have data for it, but I have been a Github user since 2012 and have found it to be down often for pretty much that entire time. I always figured it's cultural to a degree–new features always seem pretty buggy/underbaked, and often continue to long term but remain unloved and incomplete.
- zeroq 2mo agoI has never been so bad as in the couple last years. And it's getting worse. I never had to wonder if Steam is going to be working today, so I could play my game after work, but it's been an issue with GitHub since covid. At least for me. Fortunately, due the nature of the service, I can sit out most downtimes. Most of the time at least.
- bluedino 2mo ago
- wren6991 2mo agoAt this point, they should notify us on days that it's up
- deleted 2mo ago[deleted]
- bhouston 2mo agoWhat is the best Github alternative that has something like Github Actions? What is the easiest to switch to? I do not want to switch but it is having too much of an impact on me. It is time to give up on Github. This is just too much.
- nlightcho 2mo agoI am building an MIT-licensed compatible alternative to GitHub Actions at github.com/automata-ci/automata. Very early in development but it already runs some of our internal workflows.
- lionkor 2mo ago* GitLab * Forgejo Those are my favorites. Both you can self-host for your company, including CI/CD.
- TrueSlacker0 2mo ago[dead]
- mariocesar 2mo agoGitLab is probably the most reasonable alternative. I migrated and it took me some weeks to adapt to the new CI, but for my use case it's basically equivalent in features. I started with the cloud version, then moved to self-hosted because it wasn't a big effort for our team. We also reduced our monthly invoice by about 50% after the move.
- vinnymac 2mo agoI’m hosting my own https://tangled.org https://tangled.org knot and spindle, and also hosting and building my own Frontend browser for https://forgejo.org https://forgejo.org looking forward to open sourcing it in the future for others to enjoy. For people who want a similar experience today, I’d recommend trying Codeberg (An official instance of Forgejo) though. However, keep in mind they voted in July to ban mostly AI generated repositories. You can read about that here: https://blog.codeberg.org/protecting-our-floss-commons-from-llms.html https://blog.codeberg.org/protecting-our-floss-commons-from-...
- vanillax 2mo agoThis is what happens when you try to run on Azure.
- sharts 2mo agoQuestion to those who work at Github…what the heck is going on? Why?
- s_dev 2mo agoI recall reading years ago that cloud services were expected to run with a reliability of 3 or 4 '9's and that if they didn't competing services would quickly overtake them in adoption. The industry was supposed to be that cut throat. Has big tech reached a similar status like banks in that they are "too big to fail" i.e. when they do fail we all just look the other way and say: "well everyone else is out too". Didn't someone recently calculate that GitHub is running at 95%? For comparison the Irish Rail service which is not reliable has 80% of it's trains run on time. This seems absurd and really challenges a lot of ideas I had about big tech and cloud infrastructure. GitHub seems to have remained the dominant player relative to GitLab etc.
- akmarinov 2mo agoCompeting services can't afford the data storage to compete with Big tech
- threetonesun 2mo agoThis is the important part, we've moved away from monopolies on software to creating a vertical stack that allows a few companies to corner all cloud hardware, which let's them prevent anyone from competing on both price AND scale.
- Galanwe 2mo agoThat canot happen if the market becomes monopolistic, with every bigtech out there buying every startup worth a penny. The erosion of anti trust in the US created this monstrosity.
- hmry 2mo agohttps://vimeo.com/355556831 https://vimeo.com/355556831 We don't care. We don't have to. We're the phone company.
- willchis 2mo agoA lot of it is inertia I think. I hear people saying that they "just use so-and-so for version control" but really we all have tons of CI/CD build and test pipelines, config, business processes etc in Github (rightly or wrongly).
- sarjann 2mo agoYou would think for a company that has close to a monopoly of developer mind share wrt git that they'd maybe put in the bair minimum to get several 9s.
- perks_12 2mo agoThe LLM code influx is not the problem. Microsoft mismanagement is: https://damrnelson.github.io/github-historical-uptime/ https://damrnelson.github.io/github-historical-uptime/
- deleted 2mo ago[deleted]
- MallocVoidstar 2mo agoGitHub's historical uptime page is fake, they backfilled it with 100% uptime going back to 1996: https://www.githubstatus.com/uptime?page=200 https://www.githubstatus.com/uptime?page=200
- standwportugul 2mo agoseems to be correct. there's no record of the outage on 8/13 :/
- let_rec 2mo agoHN is likely a better source than GH status...
- pyaamb 2mo agoWow.
- copper-float 2mo agoWhy would they do that?
- tomjakubowski 2mo agoStrange. The back button in the UI is disabled once you get back to September 2016. https://www.githubstatus.com/uptime/8l4ygp009s5s?page=40 https://www.githubstatus.com/uptime/8l4ygp009s5s?page=40 The earliest recorded downtime for Git Ops I could find is in December 2018. https://www.githubstatus.com/uptime/8l4ygp009s5s?page=32 https://www.githubstatus.com/uptime/8l4ygp009s5s?page=32
- leishman 2mo agoI don't understand why Github hasn't solved this problem with pricing updates. My understanding is they are getting hammered with LLM generated code growing their traffic by over an order of magnitude. So why not rate limit non-paying users and charge for whatever scarce resource is being consumed that is causing them to constantly fall-over? This seems like a basic economics problem.
- noahbp 2mo agoBecause any price at all will immediately cause users to shift to another platform, and GitHub's value is that it is _the_ place to put your code on the internet.
- ljm 2mo agoAnd they can keep training their own models off of the code, and on private repos too. AI makes investors/shareholders go brrr.
- aurareturn 2mo agoAnd another platform will suffer the same thing and charge probably even more?
- MisterPea 2mo agoI wonder how much network effects help here. There's a lot of consumer surplus with the features GitHub offers. I'm sure they can have better pricing tiers to capture the surplus without losing too many users.
- dannyw 2mo agoThe network effects isn’t that much, and like what we see with Steam, you want to be where the audience is. More realistically, MAU or something is a metric/OKR. It’s easy to imagine why a business wouldn’t want to cap that.
- graceful6800 2mo agoAnd the audience you want are users who will never, ever pay to get access. If GitHub starts throttling free users, they throttle the audience you're talking about far, far harder than you. The audience will go away to somewhere you aren't. Then what?
- DataDive 2mo agoMaybe they should charge a little more per action, and the onslaught would stop. Seems like a simple solution.
- z3ugma 2mo agoYou know, I think Fossil with its integrated issue management right in the repo is actually a perfect match for the LLM era. Maybe today is the day I migrate to using a Fossil forge with GitHub becoming increasing untenable. Anyone else using Fossil?
- robin_reala 2mo agoBiggest problem with Fossil is immutable history. That’s a design choice, and I respect them for that, but it’s not the right choice for me.
- ad_fontes 2mo agohttps://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/ They're struggling to maintain a single nine these days.
- mzajc 2mo agoCertified eleven nines SLA: 9.9999999999%
- Retr0id 2mo agoInterestingly this dashboard says there are currently no issues. Edit: I just realised it's hosted on gh pages and therefore probably can't be updated
- crucialfelix 2mo agoIt's a historical record. https://www.githubstatus.com/ https://www.githubstatus.com/ is today
- bmitch3020 2mo agoThey're targeting 9 5s of uptime now. 55.5555555%.
- zahlman 2mo agoThat page shows today (and every day since the 14th) all green, though.
- ebfe1 2mo agoIt's DNS issue, i'm telling ya!
- fzumstein 2mo agoFunny enough, I received a marketing email from GitHub during the outage with the following subject: "What if every pull request you started actually shipped"
- Aachen 2mo agoHuh, they usually do? I'm not a full-time developer though so I'm surely biased towards doing the obvious quick fixes or already-discussed things, but discussing how to solve a problem before throwing something at the wall seems like the normal thing to do for me Or is their point about abandoned projects where the dev never clicks release after merging, or even never merges?
- Laurel1234 2mo agoThe point is you can't ship shit during an outage.
- Aachen 2mo agoYeah I saw the humor of that :) Just curious about the thing they're trying to even sell, it doesn't sound like something they can offer even if they had a good SLA
- BowBun 2mo agoThe joke was that we have open pull requests that we cannot merge because of this downtime.
- Aachen 2mo agoYes, see sibling comment posted slightly ahead of yours (dead/invisible at first, to be fair)
- __vivek 2mo agoGo touch grass
- Bridged7756 2mo agoI'll never get lack of sex used as an insult, unless you are a teenager. Is your self worth that tied to sexual activity so to use it as an insult? Is it that a rare thing to "achieve" for you to put it on a pedestal and demean others based on the lack of it?
- coolThingsFirst 2mo agoGo touch grass isn't meant metaphorically. It literally means go outside. Has nothing to do with sex.
- amrit_mirch 2mo ago[flagged]
- hmokiguess 2mo agoI'm not mad, I'm just disappointed.
- 4petesake 2mo agoI'm mad, but also secretly happy as it pushes their uptime numbers lower, which has its own, self-reinforcing allure.
- georgehotz 2mo agoWe're moving to self hosted Gitea. It's never been easier to do devops with the help of LLMs. I cannot believe how flaky GitHub is. https://git.tinygrad.win/tinygrad/tinygrad https://git.tinygrad.win/tinygrad/tinygrad
- dboreham 2mo agoFunny because I spent a couple of years on self-hosted Gitea, including doing some work on Gitea itself to add features we wanted. Then I changed projects and thought "well that was a lot of work, let's just do what everyone does and use GitHub". Now twiddling my thumbs this morning...wondering if I need to resurrect the Gitea deployment.
- stephenway 2mo agoThis is pretty much why I started Fjord. I like Forgejo/Gitea, but didn't think “run your own forge forever” should be the only alternative to GitHub. We run dedicated Forgejo instances for people who want that middle ground.
- rglullis 2mo agoI'm self-hosting Gitea and Woodpecker CI for least 6 years, alongside my own docker and pypi registries. Adding x86 and ARM runners, it costs me circa $30/month to run the whole thing, and I am reasonably sure that I could make the whole thing scale at a lower cost per user than what Github charges. I am seriously, 100%, contemplating the idea of offering consulting for migrating companies and projects out of Github. Given that I am fully employed, I'd only be able to do this on the weekends. Could I get a show of hands to get an idea of potential customers?
- herpdyderp 2mo agoSounds interesting but I'm just going to do the same thing as you (self host).
- ramon156 2mo agoDoing the same thing, and I'd join you in this consulting haha. It's a breath of fresh air to know what your CI is actually doing
- BowBun 2mo agoI work at a startup with ~20-30 devs. We're talking about a project like this. I'm not sure weekends would work for an actual company, though maybe it depends. I think there would be an appetite for this. From my POV - the main areas of interest are how you can roll this out to a team gracefully without breaking everyone's workflows for multiple days. Good luck
- rglullis 2mo agoThe most natural way to roll this out would be to have a "blue/green" system, where both systems are running and the weekends would be the time to take the steps towards the migration. First set up the servers, integrate Auth/SSO (depending on the current company set up), etc. That could be done probably in a single weekend. Once this is done, the team would have two possible git remotes to work with. Given that gitea also allows mirroring with Github, the team would be able to even switch to Gitea as the "main" git remote and for PR reviews even if the CI part is still on Github. The harder part would be migrating the CI jobs. But this also can be done in parallel and no one needs to cut out their Github actions immediately. Start with the simplest of the stages, e.g, the automated test suite, and once you get the whole pipeline from Woodpecker on an staging environment, you'd could take another weekend to test the whole workflow. Once the first project is successfully migrated, it becomes a matter of repeating the process. Woodpecker is still a bit finicky and debugging it can be a bit annoying, but given that it's all based on docker it is a lot easier to debug a pipeline locally.
- lucky-rathore 2mo ago+1
- ChrisArchitect 2mo agoSome more discussion: https://news.ycombinator.com/item?id=49330684 https://news.ycombinator.com/item?id=49330684
- amrit_mirch 2mo agoi dont even know why people not using alternatives like gitlawb
- OtomotO 2mo agoI have one client that relies on github. Just one, out of dozens I've worked with over the years. It's just a constant pain in the ass. Wherever I have anything to say I prefer ANY other gitforge over this piece of shit.
- herpdyderp 2mo agoI've actually started loving GitHub down days because it means I get to spend time migrating away from them! (moving to self hosted Gitea)
- b800h 2mo agoWell I was dumped out of Github Copilot as this issue started, and haven't been able to get back in. Seems like a slightly strange thing to be connected, but feasible.
- bogzz 2mo agoThe GitHub failure unicorn image always brings me back to the good old days of trying out new Android ROMs. That unicorn used to be the logo of the Android Open Kang Project, which used to be my favorite ROM. I wonder how it made it onto GitHub.
- white_dragon88 2mo ago[dead]
- Brian_K_White 2mo ago[flagged]
- koito17 2mo agoI remember a few years back when there was 2 major outages per month. Thankfully this is encouraging me to stop working overtime for now and enjoy the rest of my night
- imnes 2mo agoGitHub, Charles Schwab, Microsoft Teams, Copilot, New York State, AWS, Progressive, Azure, Microsoft Store, Cloudflare, ADP, Google Sheets, E-Trade, Fidelity... Did Mythos break out of it's container? https://downdetector.com/ https://downdetector.com/
- piker 2mo agoMaybe it's this one: https://downdetector.com/status/windows-azure/ https://downdetector.com/status/windows-azure/
- neuronic 2mo agoBecause Google Sheets is famously running on Azure?
- chilipepperhott 2mo agoNot to mention AWS?
- piker 2mo agoIt was a qualified observation! :)
- evilfred 2mo agono, stop giving the AI companies free marketing
- leumon 2mo agoclaude also had/has some issues: https://status.claude.com/incidents/zhk4v3yv1lsf https://status.claude.com/incidents/zhk4v3yv1lsf
- DrScientist 2mo agoNever quite understood why large enterprises use github as core infrastructure. Sure use it to collab externally, use it if you can't justify running your own infrastructure, but why are large companies choosing to place code externally - which is one secret leak away from compromise?
- hbn 2mo agoPass the buck. There's no one to blame but yourself if you're self-hosting. "Yeah we're unable to offer services, but so is [X BIG CORP] and [Y BIG CORP]. It's an industry outage, nothing we can do!"
- Nemo_bis 2mo agoThe larger the company, the more likely that it's enmeshed with Microsoft in some of its parts. Microsoft is relentless in expanding its footprint with vendor lock-in and cross-sells until it replaces all competitors.
- calvinmorrison 2mo agoreminder: git is distributed
- __vivek 2mo agoSomeone tried loading the Bun Zig-to-Rust PR again.
- porridgeraisin 2mo agoClones, repo browsing etc are all working. /pull/:id/changes is not working, but /pull/:id.diff _is_. It seems parts of the API is also ok? some gh commands I tried worked. Files changed works on the mobile app somehow. I guess a particular api version or something is down. Anyway if someone needs files changed and merge status, check the mobile app. Past actions are also loading on that. [Android, India]
- standwportugul 2mo agoFunny thing about the status page is that you can't find any record of last Thursday's outage. It's all green across every service.
- karel-3d 2mo agoIs that even news at this point? Yes, github now has issues. Github is always having issues.
- catigula 2mo agoOkay, enoughs enough, time to migrate our org.
- juntz 2mo agotenth per day, I almost think my network is noet working.
- anticensor 2mo agoAnyone else getting "Cannot retrieve latest commit at this time?"
- hariso 2mo agoYup.
- larsonian 2mo agoWhatever it is, it seems to be getting worse: started with pull requests and Actions being down, now I can't even list my repos. Might be the worst one yet.
- forcedtolinux 2mo agocopilot is also down
- aaronmdjones 2mo agoOh nooo! Anyway...
- BIGFOOT_EXISTS 2mo agoAlright! Let's go make some coffee and get fresh air
- Brian_K_White 2mo agokagi's still up, so I was able to learn about alternatives. At this point github should just be your write-only mirror for publishing & discovery.
- jph 2mo agoHelp encourage alternatives by trying Gitlab.com or Codeberg.org or Tangled.org or others, and please star some projects there to help motivate more options. Self-promo links below if you would like to star a few of mine good for developers. https://gitlab.com/architecture-decision-record https://gitlab.com/architecture-decision-record https://gitlab.com/ways-of-working https://gitlab.com/ways-of-working https://gitlab.com/coordinated-vulnerability-disclosure https://gitlab.com/coordinated-vulnerability-disclosure
- crabbone 2mo agoI started my career in programming with Subversion was the most popular tool. I also had to work a little with VSS, Perforce, Mercurial and, obviously, Git. I was one of the first users of Google Code... So, relatively, not so long ago it was pretty common to host all this stuff yourself. I don't think (or maybe don't remember) Subversion having any Web interface of its own, but, since forever Git came with GitWeb. I remember configuring it for the first time: any extra bit of configuration, especially those that resulted in some added interactive functionality seemed exciting. For a week, I'd push something to my branch and immediately refresh the browser page to see my changes reflected in the remote repository :D The infatuation wore off very quickly: after a month I have almost forgotten the Web interface even existed. The cycle repeated with hosted services, the addition of PR interface, the addition of "pages", the bug reports, the built-in Wiki. After discovering the new gadget and associated hype, invariably, came the realization that the predating existing functionality was... better. The PR discussion in the Web page detached from the code is a lot worse than the PR discussion in the PR itself. The built-in issue tracker doesn't come close to the stand-alone product functionality. The built-in Wiki is ridiculously underwhelming when compared to an actual Wiki. And so was the CI. For me, it started with Gitlab. There are oh so many reasons to hate Jenkins, so, whenever anyone announced an alternative platform, I'd absolutely check it out, and so did a lot of others, I presume. I was super hyped up about the possibility of running CI from the command line, completely locally on my laptop. And then it turned out to be a bait-and-switch kind of thing. I've created monumental dozen-steps and branching pipelines connecting multiple projects only to realize that the best CI is the one that uses as little as possible of the platform tools. In the end of the day, I came to realization, that beside the social aspect of the platform like GitHub, everything that it offers on top of the essential Git repository storage is too low quality. And so do competitors. If I was ever again tasked with setting up a company code repository storage, I'd go with a physical server attached to the local office network, unless there's no office, in which case, probably, some EC2 VM would do the job... Places like GitHub or Gitlab lure you in with their free tier offering, where you get the storage space and some other goodies for free, but once you need to upgrade to the paid tier, you inevitably realize that it's not worth the money they charge for it.
- anshumankmr 2mo agoPossible if this trend continues we might have the first actual zero 9s availability.
- chilipepperhott 2mo agoThey actually _did_ hit zero nines of availability a few months ago.
- bfrog 2mo agoGitHub is down days of that week that end with day these days. If I were a paying customer I'd be cancelling soon. GitHub is sort of foundational at this point and when its down nearly every day of the week it cannot be foundational.
- logicallee 2mo agoDoes either Google or Amazon (the two other large cloud providers besides Microsoft) operate its own alternative?
- ferguess_k 2mo agoWhat is really interesting is that no insider engineer has leaked anything. What we got was essentially "LLM" hitting GitHub really hard. But there is no retro or maybe i missed it.
- felooboolooomba 2mo agoAnyone remember the end of the .com era? This feels early similar.
- decodebytes 2mo agoCannot even merge code, this is the limit for me. We are prioritising migration to a different platform and this time going to decouple CI - right now we have too many points of failure on one vendor.
- arionhardison 2mo agoApologies if you already tried this, but I have been able to merge and get some things done via command line. e.g.: gh pr merge 5062 -R <org/repo> --squash --delete-branch
- crucialfelix 2mo agoI was also able to merge a pr and do a release using cli. I'm going to leave them alone for the rest of the day.
- arionhardison 2mo agoSame, not be be obtuse; but I am just going to take this as a sign to go read a book in the park and be genuinely grateful that I have that option.
- arionhardison 2mo agoqq: HN has shadow banned everything I do, does anyone know how this works? - https://news.ycombinator.com/item?id=49334527#49334528 https://news.ycombinator.com/item?id=49334527#49334528
- figassis 2mo agomerges work fine, the git experience as well, this is a web infra issue
- kwanbix 2mo agoWell, seems that AI vibecoding is working it's magic!
- smcameron 2mo agoI wonder if you could replace the whole github issues feature with just a directory within each git repo named "Issues/". Within that, have another couple directories, "open/", and "closed/". Within "open", have a directory per issue, e.g. "such-and-such-does-not-work/". Within each issue directory, have "issue.txt", or "issue.md", which takes the place of the page for each issue on github. You could store other things in the issue directory which "issue.md" could reference, e.g. screen shots, logs, whatever. When an issue is closed, it gets git mv'ed to "closed/". You want to see a list of open issues sorted by time? Just "ls -ltr Issues/open". Want to see open issues related to the frakfrobber? "grep -i frakfrobber Issues/open/*". Add a comment to an issue? "vim Issues/open/my-issue/issue.md; git add !$; git commit -m 'Updated my-issue';" It would move the entire issues subsystem back under control of bare "git" and make it portable. Undoubtedly, I am not the first to think of such a thing.
- jasongi 2mo agoThe whole point of issues is that users can create them when they don't have repo write access.
- nafey 2mo agoCheck out Haxxy, it has a lot of fresh ideas related to issues/pr management https://youtu.be/iBDUTaKWVdU https://youtu.be/iBDUTaKWVdU
- themikesanto 2mo agoI don't think a YouTube link is the best way to evangelize a new tool.
- smcameron 2mo agoThanks for pointing me to that! Definitely some cool ideas in there. Almost seems like some of those ideas could be incorporated into git itself.
- teddyh 2mo agoUndoubtedly: <https://news.ycombinator.com/item?id=22833037 https://news.ycombinator.com/item?id=22833037>
- amir734jj 2mo agoGitHub is too important to fail, and they obviously can't fix their up-time problem. Shouldn't they open-source core and/or problematic components and ask for public to fix it? this is not sustainable. It's literally blocking development/productivity worldwide.
- szew404 2mo agoyes in germany
- nickstaggs 2mo agoHas Github Enterprise Server been isolated from these issues? Presumably it has because it's self hosted
- wejick 2mo agoI can imagine the massive growth they're in right now, old assumptions are breaking down, many things need to be rethought. That's why personally i don't hate them with all of this saga. But they need to work faster in terms of product decisions and technology.
- ryuuseijin 2mo agoJust going to leave this here - self hosted forgejo on fly.io with restic backups: https://forgejo-fly.fly.dev/forgejo-admin/forgejo-fly https://forgejo-fly.fly.dev/forgejo-admin/forgejo-fly
- cbmalll 2mo agoJune 17, 2023: Dohmke says Copilot will write 80% of code: https://www.freethink.com/robots-ai/github-copilot https://www.freethink.com/robots-ai/github-copilot Slop code is written and pushed ... Aug 11, 2025: Dohmke leaves the sinking ship: https://www.entrepreneur.com/business-news/github-ceo-thomas-dohmke-quits-job-for-entrepreneurship/495751 https://www.entrepreneur.com/business-news/github-ceo-thomas... This is a true AI victory.
- scrollaway 2mo agoDo y'all have any evidence that github's recent outages are caused by slopcode rather than the significant increase in load, which is exactly what Github & MS have been claiming as the root cause? I'm tired of these BS stories being pushed by green accounts on HN like there's some damn agenda by someone who thinks their job will be saved "if only the CEOs realized that Slopcode Bad".
- 123ahsG 2mo ago[flagged]
- scrollaway 2mo agoI have zero investments in agentic coding; in fact, my list of investments is pretty public, so I don't really know what point you're trying to make. But creating a new account to try to defend yourself against a threat you claim to be non-existent doesn't scream "I feel secure" to me.
- dabbz 2mo ago
- klaussilveira 2mo agoI encourage everyone to switch to Forgejo. We ditched GitHub and could not be happier. The experience is smoother, faster and distraction-free. Our runners are faster, our CI is smoother than ever. Transitioning was a matter of a few hours, which we took as a fun hackaton.
- ryuuseijin 2mo agoJust going to leave this here - self hosted forgejo on fly.io with restic backups: https://forgejo-fly.fly.dev/forgejo-admin/forgejo-fly https://forgejo-fly.fly.dev/forgejo-admin/forgejo-fly
- hackertyper69 2mo agoWhat is fly for?
- ryuuseijin 2mo agohttps://fly.io/ https://fly.io/ - it runs the machine and serves the traffic
- sebmellen 2mo agoHow complex is the CI migration? We’re heavily dependent on GitHub Actions and the full GitHub ecosystem by extension, but by the same token these frequent outages are destroying us.
- nrabulinski 2mo agoForgejo actions are by design compatible with GHA. Obviously if you still depend on github to get reusable actions you’re just as dependent on GitHub being up as ever, but you can very easily migrate or mirror GitHub repositories to your forgejo instance and in most cases migrating the CI requires close to no changes. Not all features are supported, but I haven’t had the need to make any changes to my actions, and they’re continuously making improvements so compatibility only goes up
- sashank_1509 2mo ago[flagged]
- kerv 2mo agoDear Mr AI. Please code a new GitHub for me and my friends. Make no mistakes.
- 4petesake 2mo agoThey forgot "make no mistakes AND write tight code that can fit demand into existing shitty unstable Azure infrastructure"
- samuell 2mo agoA self-hosted git-based issue tracker like Epiq [1] seems more relevant by each day going forward. [1] https://github.com/ljtn/epiq https://github.com/ljtn/epiq
- nightski 2mo agoAll of my code repos are on gitea (personal and professional). The instance is not exposed to the internet (wireguard access). It's fantastic honestly, simple and just works.
- george_max 2mo agoCould GitHub be affecting other sites, or maybe this is something else? Did Anthropic or OpenAI fail to sandbox their models again? https://downdetector.com/ https://downdetector.com/
- tom1337 2mo ago> Warning: Failed to download action 'https://codeload.github.com/ https://codeload.github.com/'. > Error: Response status code does not indicate success: 429 (Too Many Requests). > Warning: Back off 19.714 seconds before retry. > Warning: Failed to download action 'https://codeload.github.com/ https://codeload.github.com/'. > Error: Response status code does not indicate success: 502 (Bad Gateway). > Warning: Back off 22.228 seconds before retry. > Error: Response status code does not indicate success: 429 (Too Many Requests). > Error: Failed to download archive 'https://codeload.github.com/ https://codeload.github.com/' after 3 attempts. Nice - even their own action runners are getting rate limited atm
- dboreham 2mo agoNo fair! You got a runner.
- prdonahue 2mo agoWhat are some good SaaS alternatives to GitHub for CI (that aren't GitLab)? Is anyone doing anything particularly novel in this space?
- bagol 2mo agoWhy excluding GitLab?
- whalesalad 2mo agogitlab is a pig to self host.
- stephenway 2mo agoI build Fjord, managed Forgejo with runners. The idea is to keep the GitHub-like workflow without having to operate the forge and CI infrastructure yourself.
- nine_k 2mo ago(Umpteenth time:) GitHub is not about just publishing source code; with git, it's trivial out of the box. GitHub's value is in the PR process, in CI/CD, releases, the issue tracker, and an identity system propping all of that. This is the thing to replace, and it's quite a bit harder.
- saliei 2mo agoDamn it, this is pissing me off actually.
- abelanger 2mo agoIf you really need to merge and deploy, I've been having some luck getting things moving with the gh cli: gh pr review <xx> --approve gh pr merge <xx> --squash --delete-branch Might not help your deploy process if webhooks are degrading, but at least it can keep your remote in sync with local changes, if you need to deploy from local.
- mhovd 2mo agoI really wish I could move to a different provider, but GitHub is just so damn practical. Downtimes such as this should at least be compensated, providing an actual financial incentive to improve their services, instead of slapping AI on yet another product.
- toastal 2mo agoThe PSA is that you should always have a mirror—even if just a bare repo folks can pull from during downtime. …& this is ignoring all the moral reason for avoiding US-based, publicly-traded, proprietary software for host largely free software. They also deny access to users due to US sanctions, privacy-conscious users won’t want to create accounts/agree to ToS, & rubbing shoulders with other corpos your project can be taken down if it upsets the corpos don’t like it (see youtube-dl, Switch emulators, etc.).
- _joel 2mo agoSure, but it's not just the reoo. It's PR's, code review and you've got a bunch of actions then it's difficult (not impossible) to deal with those being down.
- toastal 2mo agoDon’t let yourself get so locked in ideally, but still keeping the code online is still quite valuable to a lot of folks.
- _joel 2mo agoSure, but you have to remember that a lot of companies use the issues/trackers/PR heavily as part of their development flow. If they go down, new work can't be scheduled.
- toastal 2mo agoDownstream often still relies on fetching & doesn’t care about any of the clerical stuff. Folks should consider self-hosting that clerical stuff anyhow given the independence you get & given MS GitHub’s uptime over the last several years.
- andrewfromx 2mo agofrom a few months ago but interesting insights: https://github.blog/news-insights/company-news/github-availability-report-june-2026/ https://github.blog/news-insights/company-news/github-availa... https://github.blog/news-insights/company-news/an-update-on-github-availability/ https://github.blog/news-insights/company-news/an-update-on-...
- billudon575 2mo agoTime to write code on stone plates
- cryo32 2mo ago"AI will destroy SaaS" "No not like that!"
- swills 2mo agoHere's an article from Oct 2025: "Microsoft’s data-center shortages to persist longer than expected - Bloomberg" https://ca.finance.yahoo.com/news/microsoft-data-center-shortages-persist-200009619.html https://ca.finance.yahoo.com/news/microsoft-data-center-shor... Perhaps relevant tho. I would imagine if they could simply throw more hardware at it they would. And I wouldn't imagine inability to throw hardware at it would be due to software scaling issues. So perhaps it is simply lack of available hardware?
- _arash 2mo agogreat
- deadbunny 2mo agoIs it a day that ends in Y?
- gortok 2mo agoSo how’s using Azure to power GitHub going? Seriously. It seems like there’s an issue every other week. It would historically be normal to provide post mortems, and maybe I’ve missed them but seems like there are almost weekly issues and no follow up into the core reasons why.
- zoobab 2mo agoSo much for "git is decentralized" lol
- stefangordon 2mo agoThe exponential growth they are having right now is absolutely insane. I would caution against assuming its an easy problem, or that anyone else has demonstrated an ability to handle this level of scale/growth any better. In May they had to solve for 30x growth overnight, and I would guess its closer to 100x by now. The reality is a centralized solution like this may no longer be a viable option with the scale of code generation.
- tryauuum 2mo agoHave your seen safe_sleep.sh?
- crote 2mo agoIs it "growth", or is it actually just "load"? Github definitely didn't 100x its paying customers, and Github Copilot doesn't seem to have any serious users. Should we really be calling it growth when revenue is flat but server load is exploding due to everyone and their cat vibecoding dozens of throwaway weekend projects? If Github didn't have insane margins before, they are definitely hemorrhaging money now. If they want to survive they have to introduce strict rate limits and 10x "Vibecoder" pricing tier sooner rather than later - but I bet Microsoft won't let them because it would hurt their already-bad AI revenue...
- lewistaariq 2mo agoIs this GitHub's way of testing how many of you are managing your PRs via agents?
- tombert 2mo agoI thought by the near-unanimous distaste for IIS we would have learned our lesson about making Microsoft products a central part of infrastructure, but evidently I was wrong. I shit on Microsoft a lot here, but it’s not because the workers are dumb or that all their products are “bad”, because they’re not. It’s because the company very clearly is only ever focused on “the next marketable product”, and will let their existing products rot. You can see this with a lot of Microsoft products. Windows NT was a a pretty cool OS/kernel at its time. NTFS was a pretty neat filesystem when it was new. They employ smart people for enough time to make a big headline, then make no effort to keep those products any good.
- chilipepperhott 2mo agoWhat I want: A self hosted version of GitHub that is a precise mirror of an actual GitHub repository. That is, PRs from GitHub appear on the selfhosted instance and my reviews from the self hosted instance appear on GitHub. That way I can work on my private instance when GitHub is down (or slow) and I can be assured my work still appears to everyone online. Does this exist?
- CivBase 2mo agoGit gets you 90% of the way there. Sounds like you just want a decentralized review solution to go with it.
- rsanheim 2mo agoAFAIK there is nothing like this out there, because there is not one standard for a "pull reauest" in the sense of how a web based forge does it. and it gets complicated quickly due to complexity of git and forks. the closest thing i've found are tooks like https://github.com/raylabshq/gitea-mirror https://github.com/raylabshq/gitea-mirror
- mirekrusin 2mo agoWhy are people complaining? It’s not a bug, it’s a feature. You have a free bank holiday, go look at green trees, listen to birds, find somebody who's wrong on HN etc. The only poor souls here are some github devops team (team of copilots?) and those using alternative services.
- Einenlum 2mo agoWell, at least their status page is up. I slowly but surely lowered my expectations.
- olek_datacall 2mo agoPRs are down for more than 2 hours now
- linhns 2mo ago“Can’t get latest commit” Ffs GitHub, get your act together.
- ikistuach 2mo agoCan’t wait for the Kevin Fang video
- ramoz 2mo agoNobody's replacing the social and community aspects of GitHub. I think it's fine if we begin to move back towards distributed software supply chain infrastructure.
- mosura 2mo agoAt least we have moved on from the tedious hug-ops response. The question is which features do we want of Github but functioning in a distributed way? Identity? Stars? Issues?
- CafeRacer 2mo ago"oh shit, here we go again"
- woeirua 2mo agoIs there any scenario in which Github doesn't start yanking features out of the free tier to protect the core service for paying users?
- Channel9877 2mo agoIMO this is what they should be doing first to stop the bleeding. I believe a huge portion of their traffic is leech traffic.
- frou_dh 2mo agoIdeally they'd grandfather in accounts that were created long before the spammer days :)
- greatgib 2mo ago"degraded performance" is the new 2026 term to say that your platform is down unusable. On my side it is funny,I'm encountering the following errors: "no server available to process your request". Maybe azure is out of capacity in its datacenters... Or they didn't pay the server bill.
- 1saadcodes 2mo agoThis has been happening a lot now huh
- hohoangphu 2mo agoCannot retrieve latest commit at this time. :<
- diogomqbm 2mo ago+1
- hohoangphu 2mo agoUnable to log in to GitHub at this time. "No server is currently available to service your request..."
- twistedpair 2mo agoMy repos and PRs have gone from throwing 500 errors, to now all being 404. Not trending in the right direction here...
- aic0d3r 2mo agoevery repo shows Cannot retrieve latest commit at this time.
- bob1029 2mo agoI am noticing a fairly mundane trend in that the GitHub outages tend to coincide with periods of (likely) high demand. This feels to me like a capacity issue more than a software bug crisis. At 4am on Saturdays GitHub never has any problems. Centralization combined with massive AI demand is almost certainly the problem. If you move to GitHub Enterprise (on your own servers), you can probably exceed the availability of the current public cloud environment. It is surprising that GHES rarely comes up as an option. It is a really good answer to this particular issue and eliminates the need to retrain the team on new tools. I understand the inclination to get salty about a vendor and cast the proverbial baby out with the bath water, but we must resist our impulses if we wish to make decisions that the business will find agreeable. The incremental additional licensing cost of moving from public cloud to on-prem is roughly $15-20 per user seat. If you only have 10-20 people using GH today and are deeply struggling with the consequences of these outages, this seems like a pretty easy decision to make.
- Ithildin 2mo agoOn the plus side, Fable is sooo snappy right now with everyone blocked by GitHub. I've never seen such fast response times.
- jubilanti 2mo agoAlmost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issues, GH actions CI, and pages host to deploy static sites. I don't use more than 100 mins of CI a month. Any recommendations? edit: GitLab free tier has all I need, but I kind of want to pay and have some kind of reliability (not necessarily an SLA, but). But their next tier is $29/mo, which is too much.
- jm4 2mo agoThis, in a nutshell, is why Github is the way it is and there's a lack of good alternatives. I'm not knocking you in particular because we're all pretty much in the same boat here. "I am willing to pay ~$5-10/mo for a reliable host... Need a repo with PRs and issues, where people can register free account and contribute or raise issues, GH actions CI, and pages host to deploy static sites." Who wants to build something to acquire that $5-10/mo business? A VPS powerful enough to host a small repository costs more than that these days. There's no opportunity here for someone to build a Github alternative and make any money. The best parts of Github that make it worth using in the first place all come down to the size of the network and that would be extremely difficult to replicate. It comes down to wanting to develop a SCM hosting service and hitting a $5-10/mo price point. To put that in perspective, people pay more than $5 for a latte and COGS on that is about $1.50 or less. A good customer will come in weekly or more often. I'd rather sell coffee than SaaS SCM.
- roflmaostc 2mo agoYou can get decent ones for $6 from Contabo VPS https://contabo.com/en-us/vps/ https://contabo.com/en-us/vps/
- Gigachad 2mo agoIt becomes worth it with scale. A VPS costs more than $5 but you can host a very large number of repos, a dormant repo takes no resources but disk space to host, its only activity that consumes resources, which is less than $5-$10 worth
- r0b05 2mo agoThere is no reason to be on github anymore. Your code will used for training and the platform enshitification has been accelerated by Microsoft. It would be wise to move to another platform or even better, host your own Gitlab/Forgejo/Gitea on a vps or at home.
- garo-pro 2mo ago[dead]
- ivanjermakov 2mo agoI have a habit of reading the source code via github web interface instead of cloning and reading it in a much more comfy text editor. Today I was forced to clone one because of "the incident". Which is a good thing.
- docmars 2mo agoHow are those layoffs treating you, Microsoft?
- kingjimmy 2mo agoAnother day, another github incident
- cebert 2mo agoGitHub can’t focus on the basics like a stable platform. However, when they release stack commits a few weeks ago somebody had time to make the hamburger menu an unprofessional stack of pancakes…cute.
- cvburgess 2mo agoWhile i get the sentiment and the frustration, I highly doubt an SRE worked on the hamburger menu. In my experience some teams move a lot faster than others and that leads to asymmetric quality. If all devs could pick up a new language and skillset overnigh then companies would have a lot more flexibility in their roadmaps, but humans don't scale that way - with or without AI.
- philippta 2mo agoThe most shocking thing to me about the entire GitHub fiasco is: No matter how bad the uptime is, no matter how bad the UI is. We will keep using the software / service we depend on. Why do we as software engineers have set fault tolerance and high availability as the primary goal of any software / infrastructure architecture? This shows it's completely irrelevant.
- deleted 2mo ago[deleted]
- esafak 2mo agoIt is not. I am just not happy with the alternatives; Gitlab, and Codeberg, for well-discussed reasons. I will pounce as soon as the right one comes along, and I have a few on my radar.
- winrid 2mo agoPersonally, Fastcomments and all my projects can easily be switched to a self hosted provider, keeping GitHub as a read only mirror. It's probably a couple days work with today's tools.
- tarxvf 2mo agoWhat? No. The people that stay are the ones that don't care, that doesn't mean no one cares. That's a selection effect. The people that care left months or years ago. I'm one of them. It was really easy, Github doesn't offer anything special. Try and run a Pagerduty with the same level of attention to detail as Github. Far fewer people use Pagerduty casually. That Github has casual users and lazy users does not mean fault tolerance and high availability are 'completely irrelevant'.
- philippta 2mo agoThat might apply to personal users. But to businesses the switching cost is just too high. We had a discussion about it on our team. It was decided to keep using GitHub unfortunately.
- hinkley 2mo agoThis weekend I managed to get a test into some sort of infinite loop that didn’t overflow or time out, so I had to single-step in to figure out where the last line it broke on. Something to do with events propagating. Oh and someone misunderstanding an unfamiliar mocking framework and not preserving someone else’s cleanup code. I won’t name and shame but his name stars with an h and ends with inkley. Mangled someone else’s abandoned PR thinking one cleanup function was a superset of another. It was not, dumdum. Event systems have interesting ways to fail that resist throwing good engineering at them to fix. For a long time I refused to have anything to do with them, but now we have whole companies built on them and also things like React and what can you do? There are harmonic failure modes where the system doesn’t fail but an event keeps echoing forever and using up 50% of the available compute before anyone notices it’s been like that for months and slowly getting worse. And then there’s the Poison Pill where a message crashes a process, then gets picked up by the next and kills that one too until they’re all dead.
- deleted 2mo ago[deleted]
- mistercheph 2mo agohmm, I would have thought they could make github 1000x more reliable with llm's
- coolThingsFirst 2mo agoDoes anyone know what could be the cause of this? LLM code or just terrible management?
- danieltk76 2mo agoheaven forbid I want to commit some code this morning
- fosterfriends 2mo agoCursor Origin launched today: https://news.ycombinator.com/item?id=49334209 https://news.ycombinator.com/item?id=49334209
- mlhpdx 2mo agoI can’t help but think of how AWS didn’t go through with killing CodeCommit and how happy that user base is to not be on GitHub.
- LeicaLatte 2mo agoI got out of GitHub last year and self hosted a vps that runs gitea. My work llm provider is GitHub copilot and we are completely blocked since morning. My question is who’s comparable to copilot vscode and cli. Multi model is table stakes.
- tom1337 2mo agoWow they just went into "another" outage > Update 16:59 UTC - The degradation affecting API Requests, Actions, Git Operations, Issues, Pages, Pull Requests and Webhooks has been mitigated. We are monitoring to ensure stability. > Update 17:30 UTC - Git Operations is experiencing degraded performance. We are continuing to investigate. > Update 17:36 UTC - Issues is experiencing degraded performance. We are continuing to investigate. > Update 18:48 UTC - API Requests is experiencing degraded availability. We are continuing to investigate.
- rickreynoldssf 2mo agoDoes anyone get the feeling that Microsoft is trying to kill GitHub in favor of ADO?
- rossdavidh 2mo agoLess conspiratorially; they may care a lot less about it than ADO, and not give it the priority/resources they would otherwise. Neglect can often do the work of malign intention.
- junto 2mo agoThat’s not the story I’m hearing. Large numbers of developers were moved away from ADO when they bought GitHub. ADO has more or less been on feature freeze for years.
- silver92bullet 2mo agoI think for Github to redeem itself in the community eyes, it should come out with a very detailed technical analysis (short of proprietary details) what went wrong technically and what went wrong from a management perspective. I think it is hard to believe the line about the LLM influx at this point. I think nothing short of a full postmortem break down will restore trust in Github at this point. Even then it Github has probably lost nearly all trust and ability to turn around its reputation in the short to medium term.
- chilipepperhott 2mo agoI absolutely agree. I don't feel that I have sufficient evidence that they even really care about these reliability problems.
- reimertz 2mo ago"Issues is operating normally."
- rpaik 2mo agoIt certainly wasn't (for a few hours)....
- birkey 2mo agomy reflection: https://www.birkey.co/2026-08-17-githubs-recent-crisis-has-a-simple-fix.html https://www.birkey.co/2026-08-17-githubs-recent-crisis-has-a...
- niffydroid 2mo agoIf the LLM usage is the cause then they need to start placing limits or add costs, otherwise normal fee paying customers will move. I work in a financial institution, while moving away from GitHub is hard our parent group uses gitlab, so really it's just our resourcing to do that is the issue, but if we asked group for help it quickly becomes possible. I feel another 2 of these instances we'll make the decision
- ashvardanian 2mo agoIf only we had a myriad of heavily funded, founder-led AI-for-coding startups that could afford to store a few source files and need all that code for training anyway :) PS: Saw Cursor’s Origin announcement a second later.
- trebaud 2mo agoShameless plug, AI built me this cli tool to visualize gh like diffs from the terminal https://github.com/trebaud/diffcat https://github.com/trebaud/diffcat , could prove handy in times like these lol
- liendolucas 2mo agoThere is no single product Microsoft hasn't touched and ruined. People should leave all Microsoft products en masse. I'm glad I'm no longer on Github. What I find a bit weird is why so many people rely on it. Today we have tons of VPS providers where anyone can host their on git repo and CI/CD pipeline. What is preventing so many people to effectively have a custom setup?
- josemwarrior 2mo ago*People should leave all Microsoft, Google, Meta products en masse
- adamtaylor_13 2mo agoMomentum + path of least resistance. My company is still on GitHub... for now. But incidents like this are becoming more common and I'm becoming less tolerant of it. I suspect many feel the same, but it takes time to persuade the masses.
- athoneycutt 2mo agoI'm at the point of having my own stuff on GitLab and mirrored to my own Forgejo or on Codeberg and mirrored to my own Forgejo. I really like GitLabs CI better than GitHub/Forgejo tho. I only really use GitHub if a project that I want to contribute to is already on there at this point.
- figassis 2mo agoI think this is the curse of scale, but also of pseudo-leaders who think leadership is "pushing engineering to rapid-fire features for number go up." You tell engineers and engineering leaders to "just add this one feature, it's really important, what's the ETA? No, that's too late, the market will have moved on, this is existential, you're a bottleneck," fire, hire, fire, hire. Meanwhile the CEO feels great, because they're delivering. The reports look nice, the posts get written, the lectures get given on X and LinkedIn about what steering a ship really means. Then the issues that required your system to actually be robust, the ones that required engineers to have spent the time engineering, show up. And it's way too late. You cannot move faster, no matter how much money you throw at it. It gets bad enough that everyone is now telling the CEO 70% of the platform needs refactoring, and even that is like solving the three-body problem, because every domain boundary is broken. Claude can't reason about any component of the system but is very confident it understands it, and ten seconds later tells you "You're right! And I won't sugarcoat it, I completely misrepresented this concept, let me go fix that by rewriting this other module." You can't rebuild GitHub. You can't rebuild components of it in reasonable time over live data and migrate over without very public incidents. So now the CEO feels very, very dumb, and can't admit it. Meanwhile a new company capitalizes on your lack of leadership and launches a competitor...and the cycle starts anew.
- Fuzzwah 2mo agoAnd then consider that GitHub hasn't had their own CEO for a year now.
- devin 2mo agoIn name, sure. Does it matter who you call the person directing the chaos?
- encomiast 2mo agoI can't speak for Github's situation specifically, but I work in an org that is often cursed by "acting" leadership. People in these acting roles don't have a real mandate to do much other than follow orders, try not break anything, and keep the seat warm. They basic tread water, which in many environments is better described as drowning more slowly.
- DonHopkins 2mo agoMy git up and go has got up and went. https://www.youtube.com/watch?v=3J0Q5SMTEM0 https://www.youtube.com/watch?v=3J0Q5SMTEM0
- renehsz 2mo agohttps://GiveUpGithub.org https://GiveUpGithub.org - why and how to ditch GitHub.
- danielmartins 2mo agoSo maybe _now_ we will have some sort of official postmortem on what's been happening so we, as customers, can make an informed decision on whether we should continue using GitHub or look for other options?