11 ms·
GitHub Actions and Pages are experiencing degraded availability
https://www.githubstatus.com/uptime/br0l2tvcx85d https://www.githubstatus.com/uptime/br0l2tvcx85d
- codingconstable 2mo agowhen arent they
- crmsystems 2mo agoactions been down for hours wtf going on.. AI bullshit
- KyleTheDev 2mo agoIncident number 6 for the month of August, notably on August 6th. This pattern does not bode well.
- paularmstrong 2mo agoFour of them were regarding AI/Copilot. So that's really just one long running incident and will probably continue to be 50/50 chance of being down.
- Topfi 2mo agoVery frustrating, nothing more I can add at this point.
- dlcarrier 2mo ago[flagged]
- presbyterian 2mo agoThe speed at which GitHub is tanking their reputation is fascinating
- Insanity 2mo agoSoon we can start posting "GitHub {x} is up!" instead, that's becoming more news-worthy lol. I know they like to blame AI/scaling, but really they are owned by one of the main hyperscalers, so I find that excuse kind of weak..
- deleted 2mo ago[deleted]
- newtonianrules 2mo agoDid Microsoft fire all the people working on the GitHub features people actually use?
- Topfi 2mo agoI mean, Github doesn't have its own CEO anymore, so arguably.
- sharts 2mo agoIt sucked with a CEO as well
- WorldMaker 2mo agoYou don't think GitHub working on seven different interfaces to copilot and vibe coding PR page changes filled with bugs are a good use of engineering time?~
- h2aichat 2mo agoI am having their issues, also... Anyway this guys are great!
- homeonthemtn 2mo agoAh. So that's why.
- dinny 2mo agoman.. again?
- peterldowns 2mo agoCan't wait for the Graphite/Cursor alternative (Origin) to become available. Actions being down for an hour in the middle of the US East workday is crazy. It's super frustrating to be an enterprise customer of Github, seems like we don't get any dedicated resources or additional stability. At this point our only option is self-host github enterprise or move away.
- stephenway 2mo agoWould you move hosting/CI before Origin is available, or are you basically stuck on GitHub until then?
- peterldowns 2mo agoI feel stuck on Github until the next generation of forges (I assume Linear is working on one too, and the Pierre guys, and there's probably more) are ready. When it works, I'm actually a huge fan of Github. It just doesn't work reliably and it's a huge operational risk to not be able to freaking deploy. We'll most likely switch to self-hosted GHE in the near-term while continuing to evaluate alternative forges — Forgejo, Gitlab, Gitea, Sourcehut, aren't appealing enough to switch.
- stephenway 2mo agowhat’s missing for you in Forgejo/GitLab/Gitea today? mostly the PR/review experience, or something else?
- alamsterdam 2mo agojenkins running on an old Dell under a desk from someone who left the company 18 months ago looks more reliable these days haha
- s_Hogg 2mo agoAs long as you don't look at it or breathe too hard near it at any time Source: me
- denysvitali 2mo agoWas? Still is
- whateveracct 2mo agoany 9s left?
- theamk 2mo agothere is one 9 of uptime, but the dashboard hasn't been updated yet: https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/ Once this goes in, I'd expect to see 89%, which is zero nines. (I'd like to say, "a new low!", but sadly we've had this before)
- ch4s3 2mo agoThey're running 9 8s of uptime.
- pbkompasz 2mo agonein nein nein
- deleted 2mo ago[deleted]
- andrewmcwatters 2mo ago[dead]
- dboreham 2mo agoSomeone needs to work on improving the way Actions deals with resource exhaustion like this. Today it exploded all the CI jobs with "failed" and an inscrutable message about "The job was not acquired by Runner of type hosted even after multiple attempts" then "Internal server error". It should say "Timed out due to no runner available, our apologies, try again later, or pay $$$ here to get priority for runners".
- deleted 2mo ago[deleted]
- arandomhuman 2mo agoI love how even self hosted workers don't work during these outages - running jobs on their infrastructure being flakey is marginally acceptable, but the API to simply schedule workflows having this availability is mind boggling. Github just doesn't seem like a serious company anymore.
- x3n0ph3n3 2mo agoMicrosoft is not a serious company anymore.
- hinkley 2mo agoThey never were. They were just really good at maintaining the bluster and backing it up with expensive lawyers. Now that they don't come in claws-first like they did when they were a NASDAQ rocket to the stars, it's easy to see. Their MO was to court an executive and sell second-rate tools to them before the people who had to use them had a chance to say anything. It doesn't matter how much evidence you can provide to the contrary, once the million dollar deal is signed, you are going to be tasked with finding reasons to say that your executive was shrewd for buying this pile of junk and unfulfilled promises, and not an insane idiot sucking away your job satisfaction as fast as they can. They did a lot of deals based on how their products would have features their competitors already have 'soon' when they haven't even started them, and a long track record of taking 3 major releases to get from something to good, and then breaking everything again by doing a 4th major release that re-imagined everything and made it horrible again. I'm not going to claim that Apple was or is a panacea. Apple doesn't use vaporware which is big, and their Cycle of Awful is 2 releases instead of 3. You could afford to skip 1 waiting for the next even-numbered version, instead of being 2 versions behind and getting pressed to upgrade.
- markus_zhang 2mo agoThey definitely managed to create a lot of reliable products. Windows NT was one of them. Up to Windows XP the products were pretty solid and each had visible improvement against the previous one. Their language products were/are still solid IMO. Maybe Visual Studio is sluggish, but we can still use an older version if we want. Plus they put a lot of effort optimizing VSCode, too. Even back in the MS-DOS/16-bit Windows days, when things broke down quite easily, I think they still provide the best bang for individual users and developers. There was no competitors who could provide so much value back then.
- Arubis 2mo agoGithub Actions are rapidly becoming an argument against dogfooding into your critical path.
- rvz 2mo agoDo we need to say this again? GitHub appears that they are never going to improve. Just look at how GitHub spark has deprecated, now we have this. After 6 years of this nonsense of "centralizing everything on GitHub", it is not a good idea at all. You might as well self host like I said before [0]. [0] https://news.ycombinator.com/item?id=22868406 https://news.ycombinator.com/item?id=22868406
- classictraffic 2mo agoThis has been preventing me from merging a PR for over an hour. I'm really tired of the constant outages GitHub has
- ptx 2mo agoAre there any other CI providers that offer free cloud-hosted Windows runners? Or has Microsoft made sure (through Windows licensing terms and pricing) that it's not possible to compete with their own CI offering? Edit: CircleCI seems to offer 750 minutes/month (whereas GitHub offers 1000 minutes/month).
- inigyou 2mo agoYou can always pay for it, use your own machine, use a VM on your own machine, or if you are developing non-slop FOSS, ask Codeberg.
- ptx 2mo agoDoes Codeberg support Windows runners at all? Forgejo only seems to have unofficial third-party builds of the Forgejo Actions runner for Windows.
- inigyou 2mo agoGood question. Even if it turns out they don't support it, I imagine they wish to support it.
- stephenway 2mo ago[dead]
- opwizardx 2mo agoHow did they get Github Pages into “degraded performance”? Aren’t those just CDN stored static pages?
- classictraffic 2mo agoI believe Pages uses Actions under the hood for publishing, so in my head it sort of makes sense for these things to be affected in the same outage
- wulfmann 2mo agoWell hopefully reads aren't affected then...
- opwizardx 2mo agoYou are right, didn’t know that. Seems like the only reliable way to run GHA jobs is to not use their runners. Hope they at least didn’t break self-hosted runners operations
- ernubufiei 2mo agothey did. > Customers using self-hosted runners may see errors or rate limiting when runners register.
- deleted 2mo ago[deleted]
- jubilanti 2mo agoAlready built pages are still being served, but I've been waiting for 3 hours for an action to rebuild a single fix to a broken link.
- fir3pho3nixx 2mo agoEver since Microsoft has taken this over are we even surprised by the downtime anymore? Piss up ... brewery ...
- fir3pho3nixx 2mo agoAre we even surprised anymore? Since microsoft (the IBM of its time) have taken this over all I can say is ... piss up ... brewery.
- player_piano 2mo agoSo, Github Actions is currently at two nines of uptime?
- steve-atx-7600 2mo agoare you sure its actually two nines and not zero?
- PhilippGille 2mo ago98.33 according to https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/
- steve-atx-7600 2mo agoWTF. Outage every month if not multiple. Even for paying enterprise plans. Also, doesn't even have RAG offering.
- homeonthemtn 2mo agoStill twiddling thumbs over here
- baggachipz 2mo agoThere's a reason I'm browsing HN right now. Dead in the water.
- hinkley 2mo agoThere are three other things I could be doing instead, but I noticed it was down when I pushed the last of my GH todo list for the day and my brain is stuck in closure-seeking. I should eat lunch.
- timetraveller26 2mo agoIf anybody is looking for alternatives, self host Woodpecker is really easy and it's a very capable CI/CD https://woodpecker-ci.org/docs/intro https://woodpecker-ci.org/docs/intro
- axod 2mo agoBroken for almost 4 hours.
- niwtsol 2mo agoNothing like the old "everything is normal" to only be corrected 8 minutes later it is actually still down and then 2 hours later they are still working on it. Aug 06, 2026 - 16:27 UTC - Update - Pages is experiencing degraded performance. We are continuing to investigate. Aug 06, 2026 - 16:19 UTC - Update - Pages is operating normally.
- rwz 2mo agoHave there ever been a comprehensive account from a GitHub insider on why their reliability tanked so hard since the MSFT acquisition? I'm genuinely curious what changed, what their processes are and how they internally think about their reputation being in the gutter with all these incidents.
- the_real_cher 2mo agoI don't know why you've been flagged. This is a perfectly reasonable request presented politely that many of us are also wondering!!
- digitalsushi 2mo agoi'm not carrying anyone's water but i always guessed that maybe half of us seeing how many tokens we can spend for a year straight maybe stressed tested their platform for a year straight
- alamsterdam 2mo agoIt's been hours :( I have sympathy for the on-call team trying to resolve it, most of us have been there done that. But seems something is systematically going wrong at GH
- yashap 2mo agoIt's honestly insane how terrible their reliability is. Over the past 4 weeks, 8 days with GitHub Actions outages, many of them multi-hour outages: >3 hours on each of July 9th, July 20th and today, and 1.5 hrs on July 23rd. Outages happen, but this many outages so close together, and so many of them so major/long lasting, something is systematically wrong for sure. It's been seriously hamstringing our ability to ship code at my company.
- alamsterdam 2mo agoMon and Dad (MS) are (generally) pretty solid with uptime. What is happening at GH? Rate of change trying to keep up with new challengers? Over-reliance on AI? Engineers trying to debug slop?
- yashap 2mo agoYeah who knows, would be interesting to hear an inside take if any readers here are also GH devs! They're at 93.91% uptime over the past 90 days, according to https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/ , and that doesn't even include today's outage yet. A glorious one nine of reliability.
- marcprux 2mo agoI see two nines in there…
- warmwaffles 2mo agoDon't throw shade, there are two nines in that percentage for now. Miles a part though.
- canadiantim 2mo agoAh that checks out, was wondering why my PR's were piling up.
- jjice 2mo agoOn other occasions, I'd take this as a time to have a walk because I'm blocked. Unfortunately, I need to get some stuff out for a customer quickly. Can't do anything about that though. GitHub is the only product in it's size class that I use that has this kind of incredibly poor uptime. I'd love to know what the most common root causes for these outages are.
- throwaway613746 2mo ago[dead]
- sharts 2mo agoThey are known are engineers pushing features that bloated product management folks keep pushing so they can justify their jobs on LinkedIn. I'm not sure why this particular industry is so abysmal at making things even semi-reliable after decades of research, educated workforces, and loads of cash.
- rochak 2mo agoCorporate greed and late stage capitalism. Welcome to the future. We know you’ll love it.
- 927373912092 2mo ago[dead]
- inigyou 2mo agoThis blog series may shine some light on possible root causes: https://news.ycombinator.com/item?id=47616242 https://news.ycombinator.com/item?id=47616242
- deleted 2mo ago[deleted]
- deleted 2mo ago[deleted]
- deleted 2mo ago[deleted]
- earthpyy 2mo agoThat's why my CI on main branch didn't triggered.
- gajus 2mo agoso... what happened?
- jmaw 2mo agoSorry folks, guess my GHCP query was too large...
- opiniateddev 2mo agoGiven the recent history of outages, I wonder how many are seriously considering moving off GitHub for anything other than code hosting. I mean actions / workflows.
- dabbz 2mo agoMy company moved to GH Actions 6 months ago even after I pushed back with a "Are you sure given their reliability issues of late?" Now I'm stuck twiddling my thumbs with PR checks stuck/failing...
- inigyou 2mo agoBecause the exec played golf with a Microsoft exec. That's what really makes decisions.
- Waterluvian 2mo agoTo offer a data point (not a tribalist argument): GitHub Actions being down this often is still less expensive than the cost of switching everything somewhere else. Would rather have my team walk away from the PRs and do other tasks than have engineering effort, meetings, design pages, scheduling, etc. for switching over. This is annoying and I'm here because it's down. But it would have to be far worse to come close to actually being worth changing.
- SoftTalker 2mo agoA case study in vendor lock-in.
- Waterluvian 2mo agoPretty much, eh? If I could right now: 1. go sign-up elsewhere 2. Log into GitHub and point Actions to that new host 3. All my actions files immediately worked without question I'd probably give it a spin and make a wiki page explaining how to swap back and forth. No meetings. No design issues. No scheduling. Just a flip switch on who to pay for computers.
- m132 2mo agoAt this point maybe they should consider sending out announcements when it is working instead
- steve-atx-7600 2mo ago#0-nines
- m132 2mo agoHey, there's still plenty if you don't mind the leading 8
- verdverm 2mo agoHave they aimed for 86 uptime?
- logicchains 2mo ago67 uptime should be within reach for them.
- ChadNauseam 2mo agoI've always thought it was unfair that the 9 in 9% uptime doesn't count.
- gnulinux 2mo ago"1 nine" tends to mean "90% availability" i.e. 37 days of downtime per year. 9% availability would be an uptime of ~33 days a year, I think at that point, we're pushing the semantics of "available" if the service is down the entire year except one month on average.
- annzabelle 2mo agoI offer a nine fives colo.
- jasonephraim 2mo agoI noticed my CI throwing errors all of a sudden. I sure wish they would become more active in alerting folks or build it into these tools - especially as these occurrences are becoming more frequent. Possibly an API-accessible services status. Then, at least we could build in our own checks when we hit errors and not have to hunt down what all is broken.
- vladak 2mo agoI knew that when the build actions started failing en masse and my newly submitted PRs did not trigger the build actions at all (besides the mandatory one in my organization), it seemed logical to me to look at HN first.. Especially troublesome in the middle of trying to fix a high score security vulnerability when the release vehicle is Github.
- asxeem 2mo agoIt's been way too long
- asxeem 2mo agoIt's been way too long now...is this normal?
- rootnod3 2mo agoSelf-hosting is king.
- mschuetz 2mo agoExcept anything I'd self host would be down much more often. I've hardly ever actually experienced down time issues with github when I needed it.
- thecatapps 2mo agoI've never understood this argument. Even if self-hosted things were offline more often (which I've never found to be the case, I've had Forgejo + runners running for a year now with no downtime), the real benefit is that you yourself can work to bring it back online when it does, rather than waiting on a large, slow-moving organization to figure out what slopped PR caused their global service serving ungodly amounts of RPS to go offline again.
- onraglanroad 2mo agoI wrote my reply before yours appeared but it's basically agreeing. A simple Forgejo hasn't given me any grief. It really seems simpler. Maybe they're hosting in us-east-1 though :)
- crmsystems 2mo agolol
- Kinrany 2mo agoI don't follow, how is that better? It's down more often AND you have to do more work.
- thecatapps 2mo agoExcept it's not down more often and it's not a heavy lift. It's not a mail server, it's a Postgres database, a Golang app, and backups (and some providers will just handle that for you!).
- bulyaki 2mo agoIn the news tomorrow: SpaceX's newest Grok model just got out of the sandbox and hacked into Github... Grok is so very very dangerous, their engineers only enter the server room in foil hats
- SoftTalker 2mo ago[flagged]
- verdverm 2mo agoThis seems persistent and endemic, have they said anything about why it's been so bad and what they are going to doing to improve going forward?
- TavsiE9s 2mo agoCan't they haven't hooked up CoPilot to their Xitter account just yet.
- the_real_cher 2mo agoMy experience working at LinkedIn was that, after Microsoft took over, they offshored a huge part of their infrastructure and turned the entire culture into one of performative based engineering instead of results based engineering. If you implemented a tool and it worked one time for your presentation to management that's all that mattered. The actual company employees using it downstream in prod basically had to constantly QA the alpha software they were forced to use and the authors of the tool were hard to track down if they even still worked there. And if you did find the author or the team they would be very resistant to admitting there was an issue because it LOOKED bad. So many tools I used were fragile and buggy, it was clear the authors just presented the happy path to management to get the note added to their promotion packet and the rest of the company just had to deal with the fallout. My team implemented this product that the entire company used that was broken and buggy as hell but they kept presenting the product to management as this amazing product and nothing was ever done about how broken it was. One of my team members came from Apple and said Apple's tool to do the same thing was much better. The tool my team worked on was a well known pain point amongst the rank and file but management was very detached from the rank and file, which I guess ultimately was the primary problem. If Github is having the same issues I feel for them.
- __rito__ 2mo agoI had tried downloading release assets of two different OSS that I use, and all requests failed. It was before it became a news and a trend in X. Really frustrating experience.
- deleted 2mo ago[deleted]
- rvz 2mo agoAs I said 6 years ago. [0] You would be better off self-hosting than using GitHub or GitHub actions. No CEO of GitHub exists and now it is falling over again. There is no better time to self-host. [0] https://news.ycombinator.com/item?id=22868406 https://news.ycombinator.com/item?id=22868406
- sehw 2mo ago[dead]
- buzzwords 2mo agoDealing with an incident on prod is extra difficult when your pipelines are not running.
- SwiftyBug 2mo agoyepsies
- hacker_88 2mo agoAzure
- dwoldrich 2mo agoSpin 'em off Microsoft, you are terrible at this.
- deleted 2mo ago[deleted]
- sitzkrieg 2mo agousing github in the big 26 is self ownage
- cebert 2mo agoIt's cute that someone at GitHub had time to make their hamburger menu pancakes to promote stacked PRs, but nobody has time to make the platform stable.
- zehaeva 2mo agoI don't think this portents anything great for software in general. We're a good year+ into the use LLMs for all major bits of software that we all rely upon and GitHub here is down to one 9 of uptime. I've been using GitHub for a _long_ time, my first commits there go back to August 2009!, and I honestly don't recall GitHub going down as much as it has in the last year. I'm sure there's other things happening in the background, but I can not help but believe that this is directly correlated with the increase of LLM usage. Though I would love to hear someone else's pet theory how a rock of the internet went from four+ nines of uptime to maybe one.
- askonomm 2mo agoTo me this correlates more to them being bought by Microsoft, a company known for being seemingly incapable of creating quality software to the point that it's not even funny anymore, and also known for sloppifying all the products they touch.
- IshKebab 2mo agoI don't think so. GitHub was bought by Microsoft 8 years ago and people have only started complaining about its uptime in the last year or so - exactly correlating with the surge in LLM use.
- pluralmonad 2mo agoDidn't github also migrate at azure recently? That certainly can't help.
- deleted 2mo ago[deleted]
- onraglanroad 2mo agoI don't think so. I've seen those complaints for more than a year. I have an Ops background and I strongly suspect they were given a stupid timeline for the Azure migration. I've got to believe Microsoft have decent Ops people but the management wanted to move faster than was reasonable and screwed it up. Move one thing at a time and double check it all works and you can do a migration like this.
- muralimadhu 2mo agoDoes anyone recommend an alternative? We've already moved our runners to blacksmith, looking for a control plane as well. We are tiny startup that ships at high velocity and this kind of downtime is highly disruptive for us
- stephenway 2mo agosince you’re already on Blacksmith, how much of the remaining dependency is actions syntax vs GitHub itself?
- muralimadhu 2mo agoThere's stuff like permissions, integration with PRs etc
- muralimadhu 2mo agoI dont mind going through the pain if there's a great alternative.
- stephenway 2mo agowhat would make an alternative great enough to justify the move?
- mitchjj 2mo agoLet me know if you'd like help trying out Buildkite. Control plane with choice of hosting/hosted alongside lots of other flexible primitives.
- inigyou 2mo agoWant to be a guinea pig customer?
- idkasam 2mo agoAvrea.com is a great alternative — a new player, but insanely fast and reliable. You get a ton of control and flexibility, and they’re building with insane velocity. I’d definitely give them a try if I were you.
- nnucera 2mo agoMiniStack is currently affected to keep up the releases :(
- blixt 2mo agoIt would seem like GitHub is in a precarious situation. We have many agents per employee working in parallel pushing way more commits than was humanly possible before AI, triggering GitHub actions a lot more than the workflows were built for, causing Actions costs to escalate (they really aren't cheap if you compare to hosting it yourself), meanwhile working with YAML workflows is just a pain, and just writing code would be so much more fun and AI compatible[1]. At the same time, GitHub has about ~3 different PR review UIs? And they're all half-bad? Any decently sized PR triggers their "optimized for large PRs" UI which jumps around randomly in my experience. If you don't get that UI and keep the scrolling one (there's an old and a new one btw) then god forbid you click a line number because at some point your browser will randomly scroll back to that line and it won't unstick. Now Linear[2] (and others) is replacing the PR review experience for the agentic era. I'd love to see a solid AI first Git + CI + reviews. [1] Cloudflare CI https://blog.cloudflare.com/ci-workflows/ https://blog.cloudflare.com/ci-workflows/ [2] Linear PR reviews https://linear.app/changelog/2025-01-23-pull-request-reviews https://linear.app/changelog/2025-01-23-pull-request-reviews
- qznc 2mo agoSounds like https://entire.io/ https://entire.io/ ?
- deleted 2mo ago[deleted]
- iamleppert 2mo agoIt's really crazy to me they can just be down for hours and can't recover their own systems. It shows they don't have the capability or infrastructure to roll back disastrous changes. These kinds of things are a tell on the organization and operational excellence (or not). As soon as a viable alternative surfaces for Github, I'm moving off and will advise all my clients to do so as well.
- deleted 2mo ago[deleted]
- rankam 2mo agoIs anyone seeing improvement - their last message implying a capacity problem would suggest some are actions are running?
- cebert 2mo agoI have sporadically had a few workflows complete for me, but most are having trouble finding a runner to start.
- alamsterdam 2mo agonope, 6 hours, nothing. I guess they are also load shedding
- rankam 2mo agoSame - their status page doesn't give me hope that this will be resolved any time soon.
- shevy-java 2mo agoEver since Microsoft took over, and then when AI Skynet took control, things started to decay. AI companies owe all of use a lot of money. By the way, why do I have to pay for increasing RAM prices here? Why are we so dependent on a few greedy corporations, anyway?
- efromvt 2mo agoEither they had a good month or I'm off my game, I actually spent a minute checking if I did something wrong with actions instead of immediately going to HN to see if it was an outage.
- macintux 2mo agoSeems like it’s been solid lately, or at least not quite so obviously broken. I was thinking last week that I hadn’t seen a GitHub outage on HN in quite a while.
- swyx 2mo agoi guess this is a good time to mention that smol forge is open for the first 100 alpha users! point clanker to forge.smol. ai/llms.txt for now its just a fast agent native git remote and u can check docs for the extras.
- molsson 2mo ago5 hours going now and the entire thing is still completely down. This level of incompetence and their total disrespect for their customers is unbelievable.
- niwtsol 2mo agoYeah, I think this one might be the straw that broke the camel's back and our team will look to migrate to something non-microsoft to be away from this nonsense.
- canadiantim 2mo agoWhat are the alternatives?
- Syntaf 2mo agoMy company is migrating repositories over to a self-hosted forgejo instance, currently very jealous of the engineers working on those migrated repos.
- siwatanejo 2mo agoBeware, CodeBerg (ForgeJo creators) has forbidden AI & crypto: https://hackaday.com/2026/07/24/codeberg-bans-cryptocurrency-and-llm-generated-code-projects/ https://hackaday.com/2026/07/24/codeberg-bans-cryptocurrency...
- dust-jacket 2mo agoBut that's on their (free!) hosted OSS platform. No-one's stopping you hosting your own projects.
- kevinfiol 2mo agoI don't think they have to worry about that since they are self-hosting.
- 2mo ago
- chiply 2mo agoTime to rant... This is absolutely unreal. Even self-hosted runners are impacted.... How can that be? The cost of this globally has got to be in the hundreds of millions to companies that use CI/CD through GitHub Actions. What if prod is broken and GitHub actions is stalling the deployment of your hotfix? What if this makes your organization miss and SLA and diminish user trust? What if this makes you miss a release that you were contractually obligated to meet? This is happening during peak dev hours on a Thursday (not that it would be acceptable at any other time). I don't understand how a service this critical to the global technical infrastructure can fail like this at all, let alone for more than a few hours. Like where's the backup generator for crises like these? You can't even use self-hosted runners? WTF? Like how can you not bring your own backup in a crisis event like this? Not that Microsoft has a good reputation, but holy moly, you'd think they would prepare from something inevitable like this.
- nlightcho 2mo agoCounterparty risk is still a thing. This is the cost of convenience, reminds me of the milkman joke in that South Park episode. Maybe a global SPOF owned by people who do not care is not the way to go.
- chiply 2mo agoDude that milkman joke made me cackle out loud. It's hard to draw a direct analogy there, but I feel like it echoes the same sentiment. A soapbox I have is that GHA workflows are scripts that could run on your machine without any of the YAML stuff. Who gives a flying about the DAG or the logs? Which, by the way, if you're willing to walk to the milk store to buy your milk, could be recreated in a much more testable and maintainable way without any of the YAML bs that GHA prescribes.... But DAGs are pretty, and logstreams showing up in a browser application instill trust (for reasons that fly far above the head of yours truly). So people go for that. Pretty DAG, nice logstream; therefore, deliver my milk. All of a sudden.... The CI/CD platform is having its merry way with your SLAs, contract abidements, and hotfix deployments. What a time to be alive. Not to rail on the South Park thing, but the blast radius of this issue also reminds me of the episode where the internet dried up. If this bs with GitHub continues, Parker/Stone will have to make a GitHub episode. How seen would we all feel if that happened?
- zenNeko 2mo agoI was scratching my head wondering why my build file isnt working, ran a working project and it didn't build either. Figured out what might be the case, but wasted an hour. I was complaining about how I should have used AI instead of manual brainwork for this instead but turns out that might have been the problem.
- noobcoder 2mo agoJust waiting for their Co pilot to fixes all bugs and misconfigurations, then they will have uptime above 100%
- jasonephraim 2mo agoThe most likely explanation for the degraded reliability: Someone at GitHub saw the Three Body Problem last year and started shifting their infra over to Minecraft servers with "physical" memory and redstone logic gates.
- atlex2 2mo agoTurns out those seams _were_ load bearing.
- jorl17 2mo agoMore than ~~five~~seven hours is fucking offensive to me. I cannot believe it.
- zer0x4d 2mo agoI run a self-hosted Gitlab instance. 100% uptime with my own runners.
- deleted 2mo ago[deleted]
- monkaiju 2mo agoIm shocked this is still going on... We moved our repos at work to a self-hosted Forgejo 2 months ago because the regular outages were getting ridiculous, looks like a pretty good call now. Honestly I dont think I've seen a tool I used regularly with such a moat lose it simply because they cant keep the service up. Also its hard to not see a pretty strong correlation between a bunch of these big companies doubling down on AI and just having their service go to s%#$. We've had similar issues with Digital Ocean recently, which is pretty lined up with them adding a bunch of "inference" services and rebranding the site to add all the "agent" marketing slop. Looking to move to Hertzner when the time allows.
- abidlabs 2mo agoIt's not too hard to switch over from GitHub actions to other runners. For example, I wrote up the steps needed in order to use Hugging Face Jobs instead, which also enables GPU runners and other flavors. I use this for several of the repos I manage (such as Trackio): https://huggingface.co/blog/github-ci-hf-jobs https://huggingface.co/blog/github-ci-hf-jobs
- timwis 2mo agoIs that not still down though because it still relies on GH actions to orchestrate?
- tom1337 2mo agoIt most likely is. We are using Ubicloud (which seems to work the same way hf jobs does) and it's also down. GitHub is not sending out Webhooks and is also not able to queue external jobs. If we had to emergency deploy anything now I'd have no idea how to really do that...
- Kinrany 2mo agoWait, were Webhooks also down, not notifying about commit pushes?
- tom1337 2mo agoI am not sure if all Webhooks were affected or only those regarding actions. Theres not much information given besides "Webhook deliveries may be delayed." https://www.githubstatus.com/incidents/qcvjkzcs7j74 https://www.githubstatus.com/incidents/qcvjkzcs7j74
- yashap 2mo agoWe use other runners (Blacksmith), and it hasn't helped, still hard down all day long. Brutal outage. As a side note, I started getting these symptoms (actions staying queued forever or not running at all) at 5pm PDT yesterday, intermittently. And definitely full outage by 8:30pm PDT. So for sure full outage for 7 hours and counting, even if you use other runners, and I strongly believe partial outage for ~15.5+ hrs before that, even if it hasn't been acknowledged by GitHub yet.
- richwater 2mo agoGotta wonder what they're up to over there. Is the AI slop that bad? Culture change?
- Wafje 2mo agoUnprecedented load. From the GitHub COO on April 3rd: Platform activity is surging. There were 1 billion commits in 2025. Now, it's 275 million per week, on pace for 14 billion this year if growth remains linear (spoiler: it won't.) GitHub Actions has grown from 500M minutes/week in 2023 to 1B minutes/week in 2025, and now 2.1B minutes so far this week. So we're pushing incredibly hard on more CPUs, scaling services, and strengthening GitHub’s core features.
- marricks 2mo agoI guess the AI Slop is that bad in terms of increasing commits/actions/etc
- mgh95 2mo agoI find this hard to believe in this context. They should be utilizing load shedding or admission control and killing/rejecting jobs rather than hard failures if it is a scaling issue. It's much more likely an actual software defect than just more load. If this was the case (which they would likely prefer) free/public tiers would be removed first to preserve paying customers services.
- woodruffw 2mo agoWhy not both? Higher base load combined with insufficient internal controls for ratelimiting/load-shedding (as in, they don’t know who to shed) would be explanatory.
- mgh95 2mo agoIf they can't implement something as simple as "decode upstream headers and determine if 429/503" I don't know what to say. Since this has knocked out all customers it indicates they likely don't have anything of this form implemented.
- javier123454321 2mo agoThis is unconscionable. It's an incredibly bad look to be up an entirety of a workday. When my company migrated from Bitbucket, I never thought that we'd be going to a worse service.
- marricks 2mo agoMy own company had a migration from GitLab to supposedly greener pastures but at least when a self hosted gitlab server had an issue someone could figure out what was going on. Absolutely zero control over GitHub.
- deleted 2mo ago[deleted]
- slicendice 2mo agoGithub is a terrible platform. We have had multiple enterprise tickets open with no response for multiple weeks after they fraudulently charged our company for services we cancelled weeks in advance. If you value any kind of real customer support or response time, I would avoid Github like the plague. They will steal your money and there is no one to even talk to about it. Their customer support is non existent (probably because their platform is in shambles).
- g42gregory 2mo agoI may be wrong, but I think this could be traced to the Microsoft's increasing reliance on the outsourced engineering workforce. Regardless of the country it has been outsourced to, the quality of service will suffer, apparently greatly as we now see. It seems to manifest in many places: AI slop, Github outages, recently Miscoroft sent me an email demanding that I subscribe to 365, in order for MS Office (which I already paid for) to continue to work. I simply moved on to the other, free, provider. Perhaps, it's time to evaluate the use of the Microsoft products?
- msyea 2mo agoI think this is because all frontier AI providers integrate with GitHub as a default git forge through their GitHub apps platform and their free tier is too generous. They should either charge some of these huge partners access to GitHub apps or partition the free tier off and have a different SLA. If the frontier AI used GitLab as a default I'm sure they'd be the ones suffering now.
- mitchjj 2mo agoThe frontier AI (OpenAI, Anthropic, Cursor, Mistral, xAI, Perplexity plus more) all run CI on Buildkite, without the suffering.
- sondelali 2mo ago[dead]
- samat 2mo agoI stopped using github for anything but git backups latest server i set up is simply a bare repo + hooks to make a local deploy after running tests and shit super easy to set up having ai do it, zero dependencies, deploy is still 'push it to the main' i have several remotes for backups and stuff
- __initbrian__ 2mo agoAll of the outages make sense to me as scaling issues. Each month, GitHub is getting the amount of commits they’d normally get in a year. And it’s growing > Yup, platform activity is surging. There were 1 billion commits in 2025. Now, it's 275 million per week, on pace for 14 billion this year if growth remains linear (spoiler: it won't.) GitHub Actions has grown from 500M minutes/week in 2023 to 1B minutes/week in 2025, and now 2.1B minutes so far this week. So we're pushing incredibly hard on more CPUs, scaling services, and strengthening GitHub’s core features. And as a fine purveyor of hand-crafted shit code for many years, I'm not gonna weigh in on that. x.com/kdaigle/status/2040164759836778878
- arandomhuman 2mo agoNot really a reasonable excuse considering this is completely broken for self hosted runners / paying customers (for a whole day).
- dcrazy 2mo agoBut you’re not self-hosting the tasking service
- arandomhuman 2mo agoBecause github does not offer the option to (and no, running github enterprise doesn't count).
- sieabahlpark 2mo ago[dead]
- kami23 2mo agoThey don't even let you really run those yourself now either, We moved off a big GHE footprint because the support for it was getting abysmal and features were slowly become GH.com. Ive been dreading the move to GitHub.com and it was worse than I expected.
- lovetocode 2mo agoClaude is about to migrate me to Gitlab in about 5m
- adamddev1 2mo agoI moved to a self-hosted Forgejo, with a self-hosted runner on another cheap Hetzner server. It's amazing how clean, snappy, and reliable it is.
- kilroy123 2mo agoThis is going to sound crazy, but I kind of wish they went back to paid accounts. This would stop a lot of this.
- dbg31415 2mo agoGitHub needs to change their slogan. "60% of the time, it works every time."
- 1vuio0pswjnm7 2mo ago49199094 | GitHub Is Experiencing Difficulties | https://www.githubstatus.com/?d=2026/08/06 https://www.githubstatus.com/?d=2026/08/06 | https://news.ycombinator.com/item?id=49199094 https://news.ycombinator.com/item?id=49199094
- deleted 2mo ago[deleted]
- shados 2mo agoThis whole mess brought to like just now little moat there is left in the AI world. Like, everyone talks about how you can just prompt a new CRM instead of paying for Salesforce. But in this case, I raced with Fable and Sol and had time to build a full featured, fully functional CI/CD workflow system that has most of the features of GitHub actions (not the ecosystem obviously) and costs less than the GitHub runners per minute, while being able to scale to millions of workflows... And I had it working end to end before the outage was resolved and was already running my apps deploys through it. It would take a little longer to do in a company with red tape and more investments in the GitHub ecosystem, and of course it only replaced actions. But it works. There is no moat.
- digitalsushi 2mo agoi can make a snickers bar at home in 30 minutes right now. what's stopping me from taking over mars inc
- edot 2mo agoBut if you just want a high-quality bar just for you, you don’t want to take over Mars Inc.
- inigyou 2mo agoDid you run millions of real workflows on it? Or else how do you know it can handle millions of workflows?
- waterTanuki 2mo agoWhen the barrier to entry for software was high, free unlimited publicly hosted git repositories made sense. Not only did you have to have some basic understanding of software, but a grasp on git itself. Now that the calculus has changed, I think we should start asking ourselves whether anyone has the right to unlimited free public repositories. We can all agree that trying to attribute any single metric to repo quality is subject to Goodhart's Law[1] (e.g. what happened to GitHub stars) yet we can also agree that the Linux Project is a much more vital repository to keep public infrastructure availble for than say, someone's vibe-coded to-do app. Is it impossible then to make any quantitative distinction between these two? We can't have both an uncontrollable firehose of AI slop and unlimited free public storage/compute at the ready for it. I say we actually need to decide what software is worthy of using up these resources for free. We already have companies like JetBrains[2] using dynamic pricing for their products. It's time Github do the same. If you want a hosted VCS for vibe coded projects that aren't being used or depended upon widely, then host the repo yourself. [1]: https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law [2]: https://www.jetbrains.com/community/opensource/ https://www.jetbrains.com/community/opensource/
- qbzenker 2mo agoYC plz fund all GH 2.0 ideas this batch
- throw03172019 2mo agoDegraded is an understatement. It’s been totally down all day. Crazy.
- thewhitetulip 2mo agoDid they try using Copilot to fix it??
- dietr1ch 2mo agoI'm surprised this still passes as news, gives water is wet vibes at this point.
- switchbak 2mo agoIt's 9:30pm pacific time - my build is still completely borked ... and we're self hosting runners. I think we need to ask for some money back, this is BONKERS. Any more of this, and we'll go full Gitlab, like we should have years ago!
- rurban 2mo agoThis was the first time for me. All tests failed, for the whole day. For 20m, ok, I can tolerate that. But for a whole day? Microsoft sucks big time.
- cagz 2mo agoOutages happen. What concerned me most was the time taken for the full resolution (almost 12 hours). I am hoping that root cause analysis promised will look into this as well and how it can be improved.
- deleted 2mo ago[deleted]
- steelaz 2mo agoThis incident made me look at the SLAs we have with GitHub, since our company is on the Enterprise plan. Interestingly, it seems that only failed GHA invocations are counted towards an SLA breach. We informed engineering to stop using GHA while the incident was ongoing, but it seems what we should have done was to hammer them without remorse to get the whole incident period (10+ hours) counted towards an SLA breach. What a scummy SLA design.
- Too 2mo agoMods, I think there is something wrong with the front page algorithm. This post has been stuck there for more than a year now. Among with assorted thoughts on AI or new model point release announcements.
- csomar 2mo agoI have a barely known/used GitHub application and losing it from time to time over some qq#%@ repo that blows up both my actions and CloudFlare workers. Over a few hundreds of repos that were installed, I have now seen two where the authors installed every AI system on the planet. This starts a vicious circle where one app comments on the PR, triggers all other installed apps, who also start commenting on the PR. This quickly reaches the limit of number of comments on the PR BUT GitHub will keep pinging you about any event that is happening to that insane PR. Of course, your app itself will fail to comment so that triggers the redundancy I have including emails from my app about a failure (which I can't read on the email itself for logs privacy, so I need to check my system logs). Just last week, I had a blow up with hundreds of failure emails. All of this was coming from a single dude PR which had nothing but AI apps fighting one another.
- 11mariom 2mo ago"Degraded availability" is just marketing bs for saying it was not working at all ;)
- microgpt 2mo ago[flagged]
- ddtaylor 2mo agoGlad I moved off GitHub a week before this happened. I just keep my repos on my server now and local backups.
- vsilent 2mo agoI was waiting entire day for gh actions to work, today everything works as usual
- catigula 2mo agoGithub CI being down is catastrophically bad.
- pianopatrick 2mo agoWhat is amazing is people do not switch away from GitHub. Maybe people are actually pretty tolerant of downtime if other things about the product or service are done right
- Proofread0592 2mo agoThe only thing that would make me switch is data loss.
- KolmogorovComp 2mo agoAlmost no FOSS project is going to move away despite the issues, because the free tier of GitHub Action is very generous and afaik is largely unmatched.
- timetraveller26 2mo agoEmbrace, extend, and extinguish
- maxlin 2mo agoThe Missing GitHub Status Page https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/ Would you know it, they're actually UP to the ... One-nines. 93.40%