8 ms·
Incident with Actions and Pages
- baalimago 4mo agoHey at least Copilot AI Model Providers have 100% uptime, so there's that
- comboy 4mo agoI have fun somebody imaging somebody internally explaining that this is a heavy traffic page and we should use it to increase reach.
- tux3 4mo agoOver the last 90 days the status page (https://www.githubstatus.com/ https://www.githubstatus.com/) shows around 2 nines of uptime for most services.
- Hamuko 4mo agoI trust that about as much as I trust Volkswagen's emissions numbers.
- rschiavone 4mo agoThe Missing GitHub Status Page (https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/) gives a better overview of their frequent outages.
- voxic11 4mo agoat least enterprise is better https://us.githubstatus.com/posts/dashboard https://us.githubstatus.com/posts/dashboard
- zero_shift 4mo ago"We need an SCM with five nines of availability. What about GitHub?" "Well. It's got a nine in it" "What percentage??" "Nine"
- deleted 4mo ago[deleted]
- deleted 4mo ago[deleted]
- deleted 4mo ago[deleted]
- mimsee 4mo agoApparently they deleted the Github Actions account as it shows up as ghost in PR comments.
- rschiavone 4mo agoif that's the case, such a thing is so absurd that it goes around and it becomes almost hilarious
- DoctorDabadedoo 4mo agoThe team got greenlight to more tokens and the problem should be fixed soon. Fingers crossed. /s source: voices in my head. Not affiliated with MSFT.. anymore.
- this_user 4mo agoI would love to know how much of their internal workflows are being handled by AI workflows. Because this seems like the kind of thing your agent might do.
- cebert 4mo agoI think we should start betting if GitHub will be down on Polymarkets or something at this point.
- fidotron 4mo agoThe future of SRE will be the company putting some amount of money on a prediction market against the site going down and you get to take home the winnings as long as the site stays up.
- cpfohl 4mo agoWasn’t my fault this time! I haven’t started work yet. https://news.ycombinator.com/item?id=47237377 https://news.ycombinator.com/item?id=47237377
- Waterluvian 4mo agoYeah but you thought about it, didn’t you?
- cpfohl 4mo agoI did....maybe my powers are growing.
- ramon156 4mo agoWas about to send my bill to you. ... You're off the hook this time./s
- Andrex 4mo agoUh oh. That means there's at least one more like you out there that we don't know about.
- cpfohl 4mo agoI always wanted superpowers, but I never dreamed it'd be like this. - So many super-heroes/super-villains
- folkrav 4mo agoHah, I know the feeling. I installed Ubuntu on a PC recently, it obviously happened to be one of the days they got DDOSed and apt repos were unreachable. I had other things to take care of, so I put it aside for the next week or so. It didn't help very much, cause after picking it back up, halfway through, Snapcraft went down.
- thesdev 4mo agoNext thing you're gonna tell us you're SRE at GitHub.
- nivekney 4mo agoThis is outrageous. Someone go create a Polymarket.
- LorenDB 4mo agoPlease don't. These "prediction markets" are a scourge upon mankind.
- bouk 4mo agoInsane, we have to come up with contingency plans now for long-duration GitHub outages because we can't safely do deployments. For a service we're paying thousands of $ per year for even though we host runners ourselves...
- sebmellen 4mo agoSame here. You’d think they could at least separate out the GitHub-hosted and self-hosted runners, so you’re still able to dispatch jobs if the self-hosted runners are down.
- ketzu 4mo agoIf the job queue is down, that wouldn't help, would it? On my repo the jobs do not get scheduled on the PRs at all, so I assume that separation wouldn't help for todays issue.
- voxic11 4mo agoThey have the github enterprise domain separated out and its working fine right now https://us.githubstatus.com/posts/dashboard https://us.githubstatus.com/posts/dashboard
- anon7000 4mo agoI’m not convinced they actually do, because GHE on the cloud tends to have the same problems as the main outages. Probably costs extra to be “single tenant” or whatever
- sofixa 4mo agoDepending on how many thousands of $ per year, it would probably be cheaper and more reliable to self-host GitLab. It's better in terms of organisational structure (you can have one, including access and secret inheritance), and (personal view) Gitlab-CI is better than GitHub Actions because it doesn't push you towards a JavaScript/NPM style dependency hell. And it's actually fairly easy to self-hosted, with options from a single machine with an omnibus package that handles everything to a full blown autoscaling Kubernetes deployment.
- mohsen1 4mo agooh man spent so much time trying to debug what's going on. I have a complex setup with GitHub Actions and self hosted runners so I thought it's something broken in my CI setup
- altern8 4mo agoWhy do they go down so often? Is it true that the reason is that they've incorporated too much AI without human review?
- insanitybit 4mo agoIt's (a) they're under massively increased load because everyone's vibing up new projects these days, (b) they've been in a weird frankenstein "on azure but also we have our own control plane" state for years and they're pushing to no longer have that be the case. I don't think vibecoding at Github has much to do with it.
- altern8 4mo agoAh, yes. A lot more repos, commits, and most importantly huge PRs. That makes sense. Thank you!
- gilrain 4mo agoNo, it doesn’t. Their competition is not similarly unstable, despite existing in the same world of LLMs. Think critically.
- datsci_est_2015 4mo agoDevil’s advocate, Pareto heuristic would let us speculate that 80% of LLM traffic would be aimed directly at the largest provider, i.e. GitHub.
- gilrain 4mo agoYour speculation is that their competitors would naturally not see a commensurate increase in instability while “only” handling 20% of the same crisis? I don’t buy the excuse. I want to hitch my wagon to those “mysteriously lucky” competitors. (And have. And haven’t had similar issues to Github, since.)
- a10c 4mo agoMy action failed with "Unexpected error fetching GitHub release for tag refs/heads/master: HttpError: Sorry. Your account was suspended" Which certainly made me shit myself, briefly.
- grim_io 4mo agoA brownout redefined.
- lachieh 4mo agoGood thing I'm wearing my brown pants today.
- DonHopkins 4mo agoShitHub https://www.youtube.com/watch?v=LGeOee7x5lY https://www.youtube.com/watch?v=LGeOee7x5lY
- drcongo 4mo agoSame. It's weird how I always find out that GitHub is down before GitHub does. Took 15 minutes before it appeared on githubstatus.com
- jaapz 4mo agoAll these monitoring rules are of the format "when 500 errors > baseline for x minutes". Otherwise you'd have monitoring alerts every second. So it is normal for users to already see errors before github officially counts it as an outage.
- echelon 4mo agoIn a high performance service with good maintenance and upkeep, you page for all 500s. A noisy pager forces the team to fix the 500s. Maybe the Github Actions infrastructure isn't run like that. edit: my oncall rotation notified on all 500s, 24/7, not just rates - https://news.ycombinator.com/item?id=48279262 https://news.ycombinator.com/item?id=48279262
- rvz 4mo agoAnother outage at GitHub with actions and pages not working thanks to the AI agents Copilot and Tay.ai creating more issues. Last time this happened was 6 days ago. [0] This time today it was caused by friendly fire by the automatic suspension of the GitHub Actions bot which is now a "Ghost" user. Since there is no CEO of GitHub to contact it we are just going to see more [1] of this again. You might need to push a critical change soon, but now you cannot. You won't get any of these issues if you self hosted as I said 6 years ago...[2] [0] https://www.githubstatus.com/incidents/g6ffrm0rfvz9 https://www.githubstatus.com/incidents/g6ffrm0rfvz9 [1] https://news.ycombinator.com/item?id=48085501 https://news.ycombinator.com/item?id=48085501 [2] https://news.ycombinator.com/item?id=22867803 https://news.ycombinator.com/item?id=22867803
- throwatdem12311 4mo agoWhen is it up?
- SideburnsOfDoom 4mo agoGithub is more likely to be up before noon in UTC timezone. i.e. before the majority of US users are online and causing load. Or maybe it's before the GitHub internal devs are online and deploying changes.
- sh-cho 4mo ago'Degraded' should be banned in status pages. It sounds just irresponsible, like "Yeah, it can be slow or something sometime. Whatever. Who cares"
- Andrex 4mo agoStraight-up, "degraded" should strictly mean "may be slower, or so slow it randomly fails" on these kinds of status pages.
- jaapz 4mo agoHow would you call "available, but only sometimes"?
- bobmcnamara 4mo agoThe whales are all dying, and we don't know why. Well, some are still alive for now though so maybe it's not so bad...
- kminehart 4mo agoAre there any GitHub Actions-compatible CI services out there that don't rely on their infrastructure? I know of depot's but no others; are these resilient to these outages or do they still lose functionality? I imagine the latter but I don't know.
- conroydave 4mo agogithub actions themselves can be self hosted, its quite nice actually to be able to keep your same patterns as cloud hosted actions and with one line change to the yaml have it running on your own hardware. I do this for actions that take 6-7 hours so I am not burning through the 3000 minutes that come free with my account.
- mdrachuk 4mo agoSelf-hosted action runners are not working too right now.
- kminehart 4mo agoThis isn't resilient to this downtime though. Our self-hosted runners are currently not functioning because of some github dependency.
- asimovDev 4mo agowhat kind of actions take that long? some kind of compilation task / gigantic test suite ala SQLite?
- kylegalbraith 4mo agoFounder of Depot here. To my knowledge, we are the first engine to support different syntaxes in this compatible way via Depot CI [0]. Great time to try it out and let us know your thoughts! We’ve built a lot of cool stuff into it like parallel steps, custom images, and a full CLI/API interface so you can literally everything without going into the web app. [0] https://depot.dev https://depot.dev
- 4mo ago
- efromvt 4mo agoIncredible how reliable the heuristic of "something seems off - probably github being down" has gotten these days
- comboy 4mo agoIt's big enough that every time it goes down, it surely stops somebody from pushing fix for what they currently have broken, so I wonder if status page services see some kind of ripple from github outages.
- JsonDemWitOster 4mo agoAbout an hour ago I was having trouble browsing repo files in the browser and I thought "A disturbance in the force, is Github down?" Refreshed HN and loaded up their status site. Nada. (Ofc, in a sensible universe, we just brush that off to a JS/Firefox glitch or my ISP.) And yet, here I am. My code is not compiling, my AI isn't vibing, nonetheless I can't work! Two more hours before I can get off!
- sylware 4mo agomicrosoft github should work at restoring interop with noscript/basic HTML browsers...
- matt_kantor 4mo agoI agree, but that's not at all related to this outage.
- sylware 4mo agoYeah, just reminding people here about that. I am trying to refrain my "off topic" rants... but such microsoft github abuse is generating so much hate due to their dominant market position, it is hard.
- deleted 4mo ago[deleted]
- couAUIA 4mo agoLoL they added "Copilot AI Model Providers" in githubstatus and it has 100% up time. Thanks for pointing out that nobody is using that thing
- chocrates 4mo agoSomeone said GitHub is racing to the mythical "zero nines of availability" and I love it
- Andrex 4mo agoHmm... 88.8888888%? Jesus, that's both horrible and seems within reach.
- LorenDB 4mo agoYep, they just need to improve their reliability by 2%! https://mrshu.github.io/github-statuses/ https://mrshu.github.io/github-statuses/
- a1o 4mo agoThis page tells a very different story from GitHub own status page. What is different here?
- alexfoo 4mo agoGithub measures/reports the SLA of the individual services. The external page linked above goes the other extreme and considers it a bad status whenever any individual service is degraded. In reality the majority of people only use 3 or 4 of the core services the majority of the time but since there's no "core services" SLA/uptime the usability of github for the majority of people is slightly obfuscated.
- JCTheDenthog 4mo agoPart of it is that it considers downtime in any of the services GitHub provides as GitHub being down. So if GitHub had 100 different services, and only one of them was down at any given time (but at least one was always down), then it would show 0% uptime.
- Miner49er 4mo agoThey've already been well below that over the last 90 days
- pistoriusp 4mo agoWhilst you're waiting for it to come back, try out AGENT-CI (which is a project I built.), which runs GitHub Actions on your machine: https://agent-ci.dev https://agent-ci.dev. (Open source, etc.) No, it's not like "act," because it uses the standard Github runner, the difference is that the control plane is an emulation of api.github.com, because of this we can do all kinds of nice things: Caching in ~0 ms. Pause on failure, so you can let your AI agent fix it and retry without pushing.
- ramon156 4mo ago"Its not like act, because we can add AI" Is what it boils down to. > codex "Fix this pipeline, use `act` to verify your changes"
- Xirdus 4mo agoI had extremely bad experience trying to setup act on my Macbook. If this is something that actually works (and doesn't steal my credentials), I'm willing to try it despite AI non-features.
- Groxx 4mo agoYea, I've had only barely-success on only a few projects with act. Usually due to steps/scripts that use github-internal APIs, but afaict far from always. I like that it exists, but what a freaking mess that it's necessary and so difficult to do.
- pistoriusp 4mo agoPlease try agent-ci; it's github actions that run locally. Nothing less.
- pistoriusp 4mo agoI did not say that, what I said was: It's not like `act` because it's not a rewrite of the runner. It's the standard runner... So the one that actually runs GitHub Actions. I have tried to use act many times, and many times I've failed. P.S. pause on failure is also helpful for humans, but I'm trying to be realistic about where the future of programming is going...
- gib444 4mo agoList of things "DoS"d by AI: - GitHub - Hiring budgets - RAM (/personal computing in general) - Electricity - Media/Content - Truth
- rock_artist 4mo agoSuper odd make productivity useless
- hansmayer 4mo agoNo way - everyone tells me the AI adoption is going great?
- aa-jv 4mo agoToo many times we've been bitten by this - it has been an issue too many times to count. This is why we don't use Github Actions, kids. Seriously, its a proprietary build service that puts the keys to the kingdom in someone elses' control. Just: No! Print this status page to PDF so you've got it handy next time someone castigates you for not using Github Actions, folks.
- dsco 4mo agoYeah I'm getting an error where it says account has been suspended. They really are becoming an embarassment
- eatyourpeas 4mo agothis has happened to me too. i am guessing then it is not a real reason?
- maratc 4mo ago`github-actions[bot]` was disabled for some time, if that's the actor which does the checkout in your setup it could be related. FWIW it's back to working now.
- galaxdb 4mo ago[flagged]
- carreau 4mo agoi still can't see many pull requests in a bunch of repositories... it's been over a month
- hkleppe 4mo agoI've started spending each github outage planning our move to an alternative. I guess I'm not alone. Where are you all moving?
- Mashimo 4mo agoWe use TeamCity for CI builds, before that Jenkins. Only accessible from the inside of the network. Even though it's selfhosted and we don't have a dedicated infrastructure team, I don't remember it ever being down in the last 12 years I have been working here.
- liamdoyle 4mo agoHas anyone actually moved off? If so where? I like being able to vote with my (teams) wallet and I'm tired of staying out of convenience
- rebolek 4mo agoI moved to Codeberg and self hosted Forgejo. I'm happy.
- deleted 4mo ago[deleted]
- moonrailgun 4mo agomy work is totally stop. cry
- BrunoBernardino 4mo agoIf you don't want to self-host Gitea/Forgejo, I recommend SourceHut for private repos and Codeberg for public ones. Happy to answer any questions you might have for either based on my experience!
- paularmstrong 4mo agoWhat's wrong with codeberg for private repos?
- pdpi 4mo agoThey only allow private repos as an exception, and only insofar as they're ancillary to open source projects. From their FAQs[0]: > Codeberg's mission is to promote free/libre software. Keeping software private is obviously not our primary use case, but we acknowledge that private repositories are useful or necessary at times. 0. https://docs.codeberg.org/getting-started/faq/ https://docs.codeberg.org/getting-started/faq/
- fatterypt 4mo agoI'm more than happy with https://codefloe.com https://codefloe.com for private repos. The service is blazing fast and the maintainer does a great job keeping it up-to-date with recent Forgejo releases.
- packetlost 4mo agoFor private repos I just have a folder on my NAS that I run `mkdir <repo name> && git -C <repo name> init --bare` in. Works great.
- r0b05 4mo agoIt's so weird because github used to be known for rock solid stability and now the entire reputation has changed.
- fooster 4mo agoYou must be new. github was never that stable.
- BrunoBernardino 4mo agoIf you don't want to self-host Gitea/Forgejo, I recommend SourceHut for private repos and Codeberg for public ones. Happy to answer any questions you might have for either based on my experience!
- danieloj 4mo agoDoes anyone use any good alternatives to GitHub Actions?
- deleted 4mo ago[deleted]
- deleted 4mo ago[deleted]
- shwetanshu21 4mo agoAnd it is bypassing mandatory GHA Pipeline check and giving green. So be careful when merging/reviewing your PRs cause.
- peterspath 4mo agoI moved a while back to Forgejo -> https://forgejo.org https://forgejo.org couldn't be happier. Highly recommended.
- cryptos 4mo agoLooks good, but I'm not sure about security: https://bearyangry.com/2026/04/29/carrot-disclosure-forgejo-security-findings/ https://bearyangry.com/2026/04/29/carrot-disclosure-forgejo-...
- gib444 4mo agoLooks lik a terrible source. Like someone ran Claude on the codebase, didn't analyse the results, then vibe coded a blog post. And the dustri.org link doesn't work for me Anyway. Forgejo's response to it: https://floss.social/@forgejo/116494295922963052 https://floss.social/@forgejo/116494295922963052
- adamddev1 4mo agoHow's the AI generated code running for ya?
- hk1337 4mo agohttps://github.blog/changelog/2026-05-15-github-app-installation-tokens-per-request-override-header/ https://github.blog/changelog/2026-05-15-github-app-installa... I'm guessing related to this? The blog post is dated 11 days ago but I just noticed a blue banner on my actions page today.
- AntonyGarand 4mo agoOther post: GitHub Actions down again today [0] Technically this one was earlier but the other one has more traction. [0] https://news.ycombinator.com/item?id=48278374 https://news.ycombinator.com/item?id=48278374
- TestUser00 4mo agolol
- jonathanbull 4mo agohttps://www.dayswithoutgithubincident.com https://www.dayswithoutgithubincident.com
- amirhirsch 4mo agoShout out to all my SF 5am crew checking if their overnight prs passed CI. Real 597 “member of technical staff” energy. I guess we should expect this, it is a Tuesday!
- markfsharp 4mo agoContingency action plan: Codeberg. Engage.
- hmmdog 4mo agoTell Claude to fix it, simple.
- Cupprum 4mo agoIt should be up again
- tcp_handshaker 4mo agoJust post here when its up. Its easier... "Microsoft’s GitHub was positioned to win the AI coding race. Outages got in the way" - https://www.cnbc.com/2026/05/22/microsoft-was-positioned-to-win-in-ai-coding-outages-got-in-the-way.html https://www.cnbc.com/2026/05/22/microsoft-was-positioned-to-...
- parisiansam 4mo agofree service is down again, let's everyone that use the service for free complain again!!! (sorry for the sarcastic comment but i find it crazy how people feel they are entitled when it's free) EDIT: sorry i meant this rant at the one complaining for the free service not for the paid customers (which is unacceptable)
- nelsonfigueroa 4mo agoThere are plenty of paying enterprise users that are also affected.
- robbie-c 4mo agoWe pay github quite a bit of money and it's down for us too
- a1o 4mo agoIt’s down for companies too, if your company org is using GitHub enterprise too.
- jmkni 4mo agoI was actually shocked when I saw what our org pays for Github, not cheap and defo not free
- PunchyHamster 4mo agoI found it crazy that you haven't discovered that people pay for github
- gloosx 4mo agoIf you take a bit of a closer look, github.com has a "pricing" page https://github.com/pricing https://github.com/pricing
- devil1432 4mo agoI wonder if these github failures are just systematic incompetence or MS cutting budget on purpose to promote its own cicd tools
- mattbrewsbytes 4mo agoOr possibly an elevated number of AI Slop Cannons aiming their LLM generated hallucinations at github hosted repos?
- jillesvangurp 4mo agoI've been against self hosting internal tools for a long time mainly because of the devops and other overhead. But AI based devops makes it so easy now to spin up whatever you want now that I'm reconsidering that. I use a lot of ansible for several of our deployments. At this point, most of that is managed via codex. For Git, all you technically need is ssh access and some backup strategy for your server. It would be bare bones but workable. And there are of course plenty of OSS things that are a lot nicer than that. I'm still using gh and gh actions and we are mostly below the freemium layer with that. But it is kind of slow and honestly a dedicated vm plus some high CPU/memory workers we can spin up on a need to have basis might be a lot faster. With GH outages becoming more common, my hand might be forced a bit. In recent weeks, I've spun up listmonk (mailing list solution), matrix (as a slack alternative), and a few other things specific to our software stack. A github alternative would be more of the same. We don't need a lot. The main objection is that with more moving parts to worry about, the workload for me also increases. Things need updating, monitoring, backups, alerting (and responding to alerts), etc. That sucks up my time and that is scarce. Another reason for self hosting these days is that with agentic AI tools, self hosted things are a lot easier to integrate into agentic systems. If it is self hosted, you don't have to worry about API limitations, rate limitations, walled gardens, etc. All the traditional SAAS silos are becoming a problem from that point of view. The more locked down it is, the bigger the motive for moving away from it. That's why we ditched Slack for Matrix. Slack is hopelessly locked down and tedious to deal with. Matrix is super easy for this.
- halapro 4mo ago> For Git, all you technically need is Technically Dropbox is just rsync. Also https://xkcd.com/1319/ https://xkcd.com/1319/ but for maintenance.
- Barbing 4mo agoDid HN forgive Slack for their business with the kids at Hack Club? https://news.ycombinator.com/item?id=45283887 https://news.ycombinator.com/item?id=45283887
- 21asdffdsa12 4mo agoGitHub Actions outage sparked direct-action, class-action, mass non-action, and widespread dis-satis-faction.
- theologan 4mo agoZero Nines. Bogus.
- jamie_davenport 4mo agoThis has become so typical that we've started working on a modern Github alternative called Plain. Perfect timing that we post https://www.jxd.dev/writing/building-plain https://www.jxd.dev/writing/building-plain just as this latest incident started.
- stevenhubertron 4mo agoThis is great because I finally set up Actions yesterday for a new project of mine and of course it’s failing today and thinking I screwed up the yaml.
- mghackerlady 4mo agoI don't understand anyone still using github for anything unless they have to or have payed for it. Move literally anywhere else
- katss 4mo agoWhat could be the cause of GitHub issues from an engineering perspective?
- trollbridge 4mo agoI switched to GitLab a while ago and then spun it up locally. Something’s wrong when my own infrastructure is more reliable than Microsoft’s.
- stuff4ben 4mo agoLet us know when your infrastructure sees the load that Microsoft's does and how you've handled it.
- trollbridge 4mo agoThe entire premise of hosting locally is you control the load.
- smilespray 4mo agoHow to kill a business 101. The brand damage to business and owner is incalculable.
- dbuckman 4mo agoI started an open source Git platform. Can be self hosted. I would call it beta at this point if you are interested in trying it. https://velogit.com https://velogit.com
- dbuckman 4mo agoI guess a link to the source code would be helpful https://velogit.com/velogit/velogit https://velogit.com/velogit/velogit
- 0xbadcafebee 4mo agoIf you want an alternative to GitHub Actions, you could self-host Forgejo Actions, but I'm not that happy with the design. I much prefer Woodpecker CI, which is an open source fork of Drone.io. It supports multiple Git backends like GitHub, Gitea, Forgejo, Gitlab, Bitbucket. It supports running jobs locally, on Docker, and on Kubernetes. And there's autoscalers built in for AWS, Hetzner, Linode, Vultr, and Scaleway. There's a bunch of 3rd party plugins (https://woodpecker-ci.org/plugins https://woodpecker-ci.org/plugins) for custom integrations. The UX is also very simple, with OAuth used not only for authentication/authorization but also setting up & accessing repos. The system architecture is great, with separate components that run stateless connected to a database, and a custom plugin is any program that takes environment variables and does stdio. The config file is a good balance of ugly YAML and convenience syntax like shell-style parameter expansion variables. It probably takes less than 15 minutes to install, set up, and run WoodpeckerCI for a small team, so it's not a big investment to try out or host. With the autoscaling plugins it lets you scale your workload up to whatever size. Honestly you could run it on a laptop since it's written Go. (to clarify for beginners: the config file docs are found in a section called "workflow syntax" (https://woodpecker-ci.org/docs/usage/workflow-syntax https://woodpecker-ci.org/docs/usage/workflow-syntax) and variable parameter expansion is buried deep in an environment variables page called "string operations" (https://woodpecker-ci.org/docs/usage/environment#string-operations https://woodpecker-ci.org/docs/usage/environment#string-oper...). poorly organized docs aside, the system itself works well)
- j45 4mo agoWith the increasing challenges from bots and ai agents created with toddler level clarity, Self hosting is going to continue to work.
- bob1029 4mo agoThe last two projects I built I did the CI/CD manually with a small win32 service that polls git and builds+deploys the main service locally. It's barely 200 lines of code. Not much to go wrong. "dotnet publish" is not difficult to wrap. The latest language models have enabled this sort of thing for me. I can integrate a mini Jenkins into every project within a 5-10 minute prompting session. This sort of code isn't hard. It's just tedious, and the LLMs absolutely rock at boring repetitive stuff. Having a win32 service start up successfully on the very first try is something I haven't experienced until 2026.
- starik36 4mo agoThat works for relatively simple scenarios. When you have to add deploying sql changes or something having to update something in the cloud, you'd have to include a lot more plumbing.
- peheje 4mo agoDeploying SQL changes? Why not just let the application do that on startup. Ofcourse be backward and forward compatible. SQL change only deploy. "Update something in the cloud" <- What do you mean?
- Yokohiii 4mo ago> Why not just let the application do that on startup. That only works on extremely simple setups and has risks. If you have only a single server, you can stall it. Now, how to roll back?
- peheje 4mo agoWe try to keep things simple. Everything has risks. No stall, run async, backward compatible. DB handles rollback via transactions. Happy to expand if interested.
- Yokohiii 4mo agoIn my world CI/CD and db migrations are 2 different things working together. CI/CD at heart is rather simple for many setups. Migrations need quite a lot scrutiny, you really want to mess up there. But if you run on gihub actions with 50/50 uptime, does it matter?
- dncornholio 4mo agoStop relying on Github. Self hosted Gitlab with self hosted (or AWS) runners running your pipelines.. We only use Github as a mirror for our public repositories.
- delf 4mo agoIf you would like less dependence on GitHub for issues and PRs, please check out GitSocial, it stores everything in git itself, making them portable and offline-first.
- CSMastermind 4mo agoWill more copilot usage fix this? We should try more copilot.
- tom1337 4mo agono maybe we should make copilot the pilot so the bad humans in the loop finally cannot break anything.
- shadowbip 4mo agohere all is ok, 3 actions without problem
- dijit 4mo ago[dead]
- ibejoeb 4mo agoWhat problem is github solving that has led it to become critical infrastructure for so many? Is it that everyone is remote and VPNs are too much of a hassle to give everyone access to a build server? Is the serving as the authoritative auth for development services? Does it provide better compliance reporting? It just isn't apparent to me what github offers that you can't get elsewhere with at the same cost and effort. I've been in some pretty large orgs with distributed personnel, but this just hasn't ever been a problem.
- Xorlev 4mo agoGitHub solved the original "code collaboration" problem, and now it's a default easy way to outsource repo management. It also has the most integrations. A lot of companies grew up using GitHub. GitHub was, once upon a time, quite stable. Things have changed: more features, more usage, and automated agents.
- ibejoeb 4mo agoI know what it does, but why is it such a problem that Actions is down? I think you did kind of answer it: "A lot of companies grew up using GitHub," i.e., they are using it as infrastructure by default, not because it does something that otherwise can't be done.
- repeekad 4mo agoIt’s well integrated into massively underpriced agentic coding (and noncoding) workflows, I doubt there’s much more reason than that. The hip thing to do now is hold all your docs in github instead of notion so your agent can traverse them locally
- vervas 4mo agoGitHub Actions is the build server. You could use any other but it is convenient indeed to have it integrated in your repository hosting service.
- vitally3643 4mo agoMy first time using GH Actions was last week. GH was so flaky that pulling a submodule failed >50% of the time. I had to write a script to retry pulling the submodule in a loop. I've done some hacky shit in CI scripts, but none made me more mad than that one.
- Onplana 4mo agoIs it about funds? Why Github is not catching up with the traffic? I know there's a mass rush on Github recently specially due to Claude Code leading users to use Github. sometimes even persuasive.
- discordianfish 4mo agoBecause scaling complex systems is not trivial
- surdu 4mo agoIt was pretty easy before October 2018, when Microsoft bought them: https://www.githubstatus.com/uptime?page=31 https://www.githubstatus.com/uptime?page=31
- booleandilemma 4mo ago[flagged]
- throwawaypath 4mo ago[flagged]
- thepaulmcbride 4mo agoWe’ve had GitHub actions for long enough, it’s time for GitHub consequences.
- cyanydeez 4mo ago>Copilot: Do you want me to implement consequences for you or babble on and on about what might entirely be a figment of your imagination (Github is up and you're on a 48 hour bender without sleep)
- pnvdr 4mo agoi would like to see consequences for "secure sleep" XD.
- shevy-java 4mo agoI think this can only happen if there are viable alternatives. For instance, the UI at setups such as https://git.devuan.org/Daemonratte/gtk2-ng https://git.devuan.org/Daemonratte/gtk2-ng is quite ok-ish, in my opinion. Granted, it is mostly copy/paste from github but that still is about 1000000x better than sourceforge's interface - and gitlab's UI too (I just hate gitlab's UI, they seem to love complexity and a billion features only 0.000001% ever need; GitHub, with all its faults, is for the most part really simple - not everywhere, e. g. GitHub wiki setup sucks, but by and large I think it is simple overall).
- ripitrust 4mo agoI initially thought it was because I ran out of action minute, and was about to upgrade my plan Lucky I came here before hitting the confirm payment button
- nickstinemates 4mo agoThe main operating model with git is going to go back to decentralized. Setting up and managing something like https://forgejo.org/ https://forgejo.org/ is a way better experience than constant interruptions by a faulty service that can't meet demand. The open source contribution model as we once knew it is dead; you're not going to accept patches from random agents. The risk is way too high. And you can see that increasingly "AI Slop" makes it difficult to be a maintainer of any semblance of a popular repo. So what's the value? A durable place to store work? hah. Discovery? That part of Github has always been shitty. So that leaves.. Github Actions? The thing that is down every other day and has been the subject of a few ~rug pulls~/attempted price hikes that are almost surely coming back?
- miki123211 4mo agoThis is your periodic reminder that Github is growing at ~14x (1400%!) annually. This would be incredible growth for a young, unprofitable, VC-funded startup, even Uber never achieved more than ~3x AFAIK. For a widely-established company that was already very well known and a market leader in its niche for many years? Absolutely unprecedented. This is a conservative estimate assuming linear growth, the actual number is likely going to be higher. Much higher. It's not too hard to grow 14X YoY if you start from a hundred customers. If you have hundreds of millions? Yeah, not so easy. [1] https://x.com/kdaigle/status/2040164759836778878 https://x.com/kdaigle/status/2040164759836778878
- rightbyte 4mo agoGrowing what exactly. Seems like a spam issue or some sort of automatic circular commit chain between alot of projects.
- bdangubic 4mo agoFeels like Github Actions is UP should on the front page (when it happens) at this point. Down is no longer front page worthy
- ceheaaf 4mo agoWhat's that? You're still using microsoft products? Guess that's your own fault.
- Simon_Feng 4mo ago[dead]
- emirhanerkan 4mo agoIn my mind there's no doubt Github datacenters can't handle the recent load that came after agentic AI. They just need to get new servers. It's simple as that.
- qwerpy 4mo ago“Just” “simple as that” Reminds me of the occasional “JavaScript developer tries to vibe debug a Linux kernel issue” comments we get here.
- wg0 4mo agoI think Anthropic should buy Github after buying bun and everything in between.
- FelipeCortez 4mo agoso they can rewrite it in Rust?
- KaiserPro 4mo agoIndeed, they are the masters of keeping a service up all the time
- hxii 4mo agoAt this point it's as if the team there went "fuck it, let's just watch it all burn down" or something. With all the recent negativity – how are they not even TRYING to fix the damn thing?
- sibidharan 4mo agoHad to figure out it was Github and not my AI Agent... Sad it got scoldings for being lazy on waiting for CI checks! What a waste of tokens!
- ValentineC 4mo agoNot reflected on GitHub Status: most of the frontier models disappearing from most people's subscriptions: https://www.reddit.com/r/GithubCopilot/comments/1toa9tf/models_disappearing/ https://www.reddit.com/r/GithubCopilot/comments/1toa9tf/mode...
- bezier-curve 4mo agoMeanwhile people using a copilot proxy [1] with a third party harness have zero issues. Very clumsy enforcement if not a bug. [1] https://github.com/ericc-ch/copilot-api https://github.com/ericc-ch/copilot-api
- sigbottle 4mo agoSad times ahead.
- mcrittenden 4mo agoI believe that's here now: https://www.githubstatus.com/incidents/xflkh26pm7vv https://www.githubstatus.com/incidents/xflkh26pm7vv
- vyrotek 4mo agoIt's crazy to us how Github Actions have these issues but Azure DevOps never has these hiccups for us even though we hear they're on the "same infra". We're happy to stick with DevOps.
- sgerenser 4mo agoWho says Azure devops is on the same infra as GitHub? I mean, sure they're both hosted in Azure data centers, but there's very little else shared between them AFAIK. I used to work for Microsoft and I heard about the grand plans to merge the two but I don't think it ever really happened.
- vyrotek 4mo agoIt's come up here in a few comments before. Perhaps not 100% physically shared infra but there's references of architecture overlap such as "The GitHub-hosted runner application is a fork of the Azure Pipelines Agent." https://docs.github.com/en/actions/concepts/runners/github-hosted-runners#cloud-hosts-used-by-github-hosted-runners https://docs.github.com/en/actions/concepts/runners/github-h... https://github.com/actions/runner-images#about https://github.com/actions/runner-images#about A few threads where blips have affected both services. https://news.ycombinator.com/item?id=42781922 https://news.ycombinator.com/item?id=42781922 https://news.ycombinator.com/item?id=41001040 https://news.ycombinator.com/item?id=41001040 https://news.ycombinator.com/item?id=35003741 https://news.ycombinator.com/item?id=35003741
- hartjer 4mo agoGoing to need to make an isitup website for it soon enough
- shevy-java 4mo agoMicrosoft is really working hard to kill off GitHub now. That's quite amazing. We have already seen this in the last some weeks, but now this has become a meme that keeps on giving. GitHub down! GitHub up again. GitHub Down! GitHub ... ...
- nomilk 4mo agoAs an Indy hacker I want to see GitHub succeed, but I ditched actions years ago - (shocking) false economy. Spend entire nights pushing to actions over and over only for complaints about weird/niche dependency issues and other oddities - the cycle time's just too slow and the DX is no fun (my pain doesn't even factor in outages; just the feature itself as it's intended to be experienced). I want to spend time talking to users and building features, not debugging weird syntax or dependency issues on a remote machine non-interactively. So why are Actions so unreliable anyway? Occam's Razor would probably suggest the domain is inherently complex/difficult; but other providers show that reliability is possible. What would Occam's Razor suggest next? Poor management..?
- frisbee6152 4mo agoWhat did you switch to, and what do you like about it?
- nomilk 4mo agoRunning tests locally. It's primitive, but incredibly reliable, and a breeze to debug if (big if) there is any dependency issue.
- xixixao 4mo agoHow do you ensure you or your contributors didn’t forget to run the tests? You’d need at least some hash of sources + test results, and check that it matches that (in CI). And you’d still deal with environment differences.
- nomilk 4mo ago> How do you ensure you didn’t forget to run the tests? Reasonable concern. In ~10 years of indy development, I haven't forgotten to run tests before pushing to main, ever. So setting up and maintaining complicated machinery to solve a problem that could (but never has) happened doesn't justify taking focus off other more important things, namely building. The benefit probably increases with team size (I'm a team of 1, so I appreciate the luxury of being able to dodge CI/CD entirely).
- ElFitz 4mo agoI recently switched from GitHub Actions to Buildkite + self-hosted runners. Setting it all up would have been tediously annoying eight months ago (Buildkite requires setting up GitHub webhooks for each repo). Last week I just had codex set up everything, ephemeral vm runners and all, using a couple of low-spec refurb mac minis, Buildkite’s API, a short-lived API token, and migrate my repositories one by one. So far so good, it’ll pay for itself within two to three months, and following today’s outage I suggested at work that we experiment with the same set up. They’re considering it.
- paulbjensen 4mo agoCircleCI right now https://gifrific.com/mick-mccarthy-stares-at-camera-and-smiles/ https://gifrific.com/mick-mccarthy-stares-at-camera-and-smil...
- timedude 4mo agoAws made a very big mistake to stop their CodeCommit service. They could have eaten Githubs lunch if they had continued to build it out
- gt010 4mo agoAt this point, GitHub should rename itself downhub.
- suis_siva 4mo agoNot to shill myself, but I'm sick and tired of this and been sick and tired for the last month. Decided to quit my job to work on https://harmont.dev https://harmont.dev
- swordlucky666 4mo ago[flagged]
- suis_siva 4mo agoI commented on the other post, but GHA's awful reliability, ergonomics and performance have caused me to quit my job and work on https://harmont.dev https://harmont.dev.
- gustavus 4mo agoAnyone else notice that the first/near top comment on every HackerNews post lately is someone saying something along the lines of "I had X problem so I went and started working on Y solution if you want to give it a look?" I don't want to delve into it any further - but something about it seems incongruous. It's not spam it's submarine marketing.
- weakfish 4mo agoI mean, it is a community that self-selects for builders and startup-types.
- ceejayoz 4mo agoSame thing's all over Reddit, too.
- suis_siva 4mo agoAh sorry! Didn't mean to be annoying. Hm is open-source and my intentions are good. I'm also trying to figure out what's good and what's not! Apologies for the spam!
- sunaookami 4mo agoIt's called growth hacking and it's indeed rude and annoying.
- vednig 4mo agoIf you see the log at https://isgithub.online/ https://isgithub.online/ the gap between two consecutive events is decreasing
- mattaustin 4mo agoRunning a company without a CEO is really starting to show..
- saltyoldman 4mo agoGit is decentralized until it's used by companies.
- viveksingh_17 4mo ago[flagged]
- blinkbat 4mo agowhat else is fuckin' new.
- toobulkeh 4mo agoAt some point I’ll need a status page for when it’s up
- terfree 4mo ago[flagged]