7 ms·
GitHub experience various partial-outages/degradations
- jmclnx 9mo agoWith linkedin down, I wonder if this is an azure thing ? IIRC github is being moved to azure, maybe the azure piece was partially enabled ?
- CubsFan1060 9mo agoIt is: https://azure.status.microsoft/en-us/status https://azure.status.microsoft/en-us/status "Impact statement: As early as 19:46 UTC on 2 February 2026, we are aware of an ongoing issue causing customers to receive error notifications when performing service management operations - such as create, delete, update, scaling, start, stop - for Virtual Machines (VMs) across multiple regions. These issues are also causing impact to services with dependencies on these service management operations - including Azure Arc Enabled Servers, Azure Batch, Azure DevOps, Azure Load Testing, and GitHub. For details on the latter, please see https://www.githubstatus.com https://www.githubstatus.com."
- ChrisArchitect 9mo agoSome more earlier: https://news.ycombinator.com/item?id=46860544 https://news.ycombinator.com/item?id=46860544
- llama052 9mo agoLooks like Azure as a platform just killed the ability for VM scale operations, due to a change on a storage account ACL that hosted VM extensions. Wow... We noticed when github actions went down, then our self hosted runners because we can't scale anymore. Information Active - Virtual Machines and dependent services - Service management issues in multiple regions Impact statement: As early as 19:46 UTC on 2 February 2026, we are aware of an ongoing issue causing customers to receive error notifications when performing service management operations - such as create, delete, update, scaling, start, stop - for Virtual Machines (VMs) across multiple regions. These issues are also causing impact to services with dependencies on these service management operations - including Azure Arc Enabled Servers, Azure Batch, Azure DevOps, Azure Load Testing, and GitHub. For details on the latter, please see https://www.githubstatus.com https://www.githubstatus.com. Current status: We have determined that these issues were caused by a recent configuration change that affected public access to certain Microsoft‑managed storage accounts, used to host extension packages. We are actively working on mitigation, including updating configuration to restore relevant access permissions. We have applied this update in one region so far, and are assessing the extent to which this mitigates customer issues. Our next update will be provided by 22:30 UTC, approximately 60 minutes from now. https://azure.status.microsoft/en-us/status https://azure.status.microsoft/en-us/status
- bob1029 9mo agoThey've always been terrible at VM ops. I never get weird quota limits and errors in other places. It's almost as if Amazon wants me to be a customer and Microsoft does not.
- arcdigital 9mo agoAgreed...I've been waiting for months now to increase my quota for a specific Azure VM type by 20 cores. I get an email every two weeks saying my request is still backlogged because they don't have the physical hardware available. I haven't seen an issue like this with AWS before...
- llama052 9mo agoWe've ran into that issue as well, ended up having to move regions entirely because nothing was changing in the current region. I believe it was westus1 at the time. It's a ton of fun to migrate everything over! That’s was years ago, wild to see they have the same issues.
- PeterStuer 9mo agoIs your mental model they are running FCFS or priority allocation?
- direwolf20 9mo agoCan someone explain the point of cloud like I'm a 60 year old grumpy Unix admin because you could just get a real server from another company by now. If the whole point is unlimited capacity but you don't have unlimited capacity and you're paying through the nose then why? Compliance?
- briHass 9mo agoCompliance and tooling are a big part of it, but the places where the big public cloud providers shine is the PaaS offerings that you don't need to write yourself. In Azure, for example, it's possible to use Entra as your Active Directory, along with the fine grained RBAC built in to the platform. On a host that just gives you VPS/DS, you have to run your own AD (and secondary backups). Likewise with things like webservers (IIS) and SQL Server, which both have PaaS offerings with SLAs and all the infra management tasks handled for you in an easily auditable way. If you just need a few servers at the IaaS level, the big cloud platforms don't look like a great value. But, if you do a SOC2, for example, you're going to have to build all the documentation and observability/controls yourself.
- booi 9mo agoCopilot being down probably increased code quality
- fbnszb 9mo agoAs an isolated event, this is not great, but when you see the stagnation (if not downwards trajectory) of GitHub as a whole, it‘s even worse in my opinion. edit: Before someone says something. I do understand that the underlying issue is some issue with Azure.
- llama052 9mo agoSadly Github moving more into Azure will expose the fragility of the cloud platform as a whole. We've been working around these rough edges for years. Maybe it will make someone wake up, but I don't think they have any motivation to.
- cluckindan 9mo ago> Azure Which is again even worse.
- estimator7292 9mo agoIt really doesn't even matter why it failed. Shifting blame on Azure doesn't change the fact that GitHub is becoming more and more unreliable. I don't get how Microsoft views this level of service as acceptable.
- Ronsenshi 9mo agoDoesn't seem like Microsoft managers care - it's not their core business, so any time anyone complains about issues with GitHub they probably think something along the line of "peasants whining again". Must be nice to be a monopoly that has most of the businesses in the world as their hostages.
- Aeolun 9mo agoAt one point Gitlab seemed like it wanted to compete, but then they killed all the personal and SMB plans, and now they’re just out of the picture for a lot of people. Their team plan is more expensive that GH’s enterprise plan.
- falloutx 9mo ago50% of code written by AI, now let the AI handle this outage.
- maddmann 9mo agoThis is why I come to hacker news. Sanity check on why my jobs are failing.
- suriya-ganesh 9mo agoIt is always a config problem. somewhere somplace in the mess of permissioning issues.
- rvz 9mo agoTay.ai and Zoe AI Agents probably running infra operations at GitHub and still arguing about how to deploy to production without hallucinating a config file and deploying a broken fix to address the issue. Since there is no GitHub CEO, (Satya is not bothered anymore) and human employees not looking, Tay and Zoe are at the helm ruining GitHub with their broken AI generated fixes.
- guywithabike 9mo agoIt's notable that they blame "our upstream provider" when it's quite literally the same company. I can't imagine GitHub engineers are very happy about the forced migration to Azure.
- madeofpalk 9mo agoI would imagine the majority of Github engineers there currently joined post MS acquisition.
- macintux 9mo agoThat doesn't necessarily mean they're happy about Azure as a backend.
- debo_ 9mo agoI've been a software "engineer" for over 20 years, and my personal experience is that software engineers are basically never happy.
- VirusNewbie 9mo agoPlenty of happy engineers at the other cloud. :)
- kasey_junk 9mo agoA bunch less today than a year ago.
- homebrewer 9mo agoI presume you mean the Oracle cloud?
- direwolf20 9mo agoNobody is happy with Oracle anything! It has some users because it is free. It has paid users because Larry Ellison bribed the government. Nobody would choose it voluntarily.
- re-thc 9mo agoJobs get stuck. Minutes are being consumed. The problem isn't just it being unavailable.
- levkk 9mo agoThis happens routinely every other Monday or so.
- locao 9mo agoI was going to joke "so, it's Monday, right?" but I thought my memory was playing tricks on me.
- fishgoesblub 9mo agoGetting the monthly GitHub outage out of the way early, good work.
- spooneybarger 9mo agowell played sir. well played.
- herpdyderp 9mo agoUnfortunately that won’t clear up the weekly GitHub outages
- jamesfinlayson 9mo agoWhat time zone are you in? In Australia I rarely have issues with GitHub (one in the last year maybe).
- herpdyderp 9mo agoDang that's the life hack here, just get out of continental USA time zones!
- imglorp 9mo agoMonthly what now? Daily would be more accurate. There were 25 incidents in January and 15 in December.
- focusgroup0 9mo agoWill paid users be credited for the wasted Actions minutes?
- bandrami 9mo agoIn the Bad Old Days before Github (before Sourceforge even) building and package sucked because of the hundred source tarballs you had to fetch, on any given day 3 would be down (this is why Debian does the "_orig" tarballs the way they do). Now it sucks because on any given day either all of them are available or none of them are.
- jokoon 9mo agoFeels like acquiring GitHub was another way to hurt open source projects
- DANmode 9mo agoHow are they demonstrating that? Or, if part of a future plan: how?
- direwolf20 9mo agoMicrosoft loves open source projects, as long as they help Microsoft make money.
- toastal 9mo agoThere’s never been a better time to migrate to another forge or at least have a self-hosted bare repository to handle outages.
- Lwrless 9mo agoRecently my download speed from GitHub releases has decreased dramatically. But I'm sure they will be fixing that with Claude Code soon... Will they?
- pluralmonad 9mo agoOn what OS have you noticed this? Very in character for microsoft to artificially slow non-windows downloads. Then again, my apt upgrades on Debian have been dog slow lately...
- Lwrless 9mo agoI was mostly on macOS. It seems to me that there's an issue with GitHub's CDN or routing.
- Andrex 9mo agoThat's surely a feature, not a bug.
- ares623 9mo agoIf you look at the history, they have as many incidents as there are days since the year started.
- WhereIsTheTruth 9mo agoIf you are still using GitHub, you have failed De-risk yourself from Microsoft
- Zanfa 9mo agoLooks like Github Actions is having another bad day today as of an hour ago, but status page is not yet updated.
- olcarl75 9mo agoah well, with agentic coding relying more and more on worktrees, I think it's about time to revive my good and old SVN server