6 ms·
Days since last GitHub incident
- _def 10mo agowoah this time i even caught it before the status page reported something - i thought they were rate-limiting me.
- laurmaedje 10mo agoIt seems to have started slowly. For me, Github releases have failed to serve requests for hours already.
- rienbdj 10mo agoIf GitHub actions break I now assume it’s them and not me. GitHub needs to work on stability ahead of AI features.
- udev4096 10mo ago[flagged]
- GaryBluto 10mo agoFriendly reminder to stop saying friendly reminder when what you're saying isn't a reminder.
- echelon 10mo agoFor any ESL folks here - "Friendly reminder" is typically used for reminding people of common knowledge. Especially for beneficial but inconvenient things that some or most people neglect to do, either because they're annoying, inconvenient, or time consuming. Things for which busy people might need a "wink wink, nudge nudge". Friendly reminder to floss. Friendly reminder to have your cancer screening. Friendly reminder to check your tires. Friendly reminder to file your taxes early. Friendly reminder to drink more water, eat fiber, etc.
- loloquwowndueo 10mo agoYou’re assuming that no native speaker is unfamiliar with the idiom and also that no ESL speaker is familiar with it.
- deleted 10mo ago[deleted]
- udev4096 10mo ago[flagged]
- tomhow 10mo agoWe’ve banned this account for repeatedly abusing other community members and refusing our requests to stop. We've given several warnings and been more than patient but if we are to have any standards at all, eventually enough is just enough.
- udev4096 10mo agoAlright, I will behave from now on. Excuse my harsh comments
- tomhow 10mo agoEveryone who is banned is able to be unbanned but we need to see a sincere effort to observe the guidelines and participate positively, sustained over a reasonable period of time. For the time being, other community members can vouch for your comments if they are good.
- udev4096 9mo ago[dead]
- udev4096 10mo ago[flagged]
- DetroitThrow 10mo agoThis quickly became much less friendly
- GaryBluto 10mo ago> Keep getting fucked By what? > The future is decentralized and p2p I wish it was but that isn't how things are going to turn out, especially if it's only people like you pushing it.
- udev4096 10mo ago[dead]
- behnamoh 10mo ago[flagged]
- llbbdd 10mo agoI don't work at Github but I'd read here recently that they've been undergoing a herculean migration from whichever cloud provider they were on to Azure since their Microsoft acquisition, and that it coincides with an increase in outages. I'm guessing that the solution here was probably just to not do that and it's too late.
- blahyawnblah 10mo agoYes I would image the issues are due to doing a migration period. Not the fact that it's moving to Azure in and of itself.
- llbbdd 10mo agoI won't blame Azure directly without a direct reason to, but as a developer often in the market for cloud providers it's definitely not the most reassuring that they're seemingly having so many migration pains. A bit of an aside, I've only personally used Azure on one project at one company but their console UI had some bizarre footguns that caused us problems more than once. They have a habit of hiding any controls and options that your current logged-in user doesn't have permissions to use. In some cases that manifested as important warnings or tools that I wasn't even aware of (and were important to me!), but the owner of the company and other global admins could see. AWS, at least for a lot of the services last time I used it, was comfortable greying most things out with a tooltip telling you your user is missing X permission, which was way more actionable and the Azure version gave me whiplash by comparison.
- nightpool 10mo agoThey weren't on any cloud provider previously. They famously had their own "metal cloud" of managed servers with everything being containerized and managed by Kubernetes. It seemed like it's worked pretty well, especially for their complex git operation tasks which had specific hardware requirements, but the official word is that apparently they're running into scaling limits with finding new datacenter capacity.
- ZeroConcerns 10mo agoThis is a bit... low-effort, isn't it? I'd at least expect a video of an exasperated Github user walking up to the '# days since the last GitHub incident' board, sliding out the '1' or '2' card, and replacing it with a '0'. I mean, that joke is as old as the universe (heck, in the brief period that I worked in an office, decades ago, I had a "# days since the last person asked a stupid question" sign to enact the exact same gag)...
- rob74 10mo agoOr an octocat standing in front of the board, holding cards from 0 to 7 in its tentacles (with the rest lying on the ground) and looking at them quizzically?
- old_bayes 10mo agoHow can we add AI to this perfectly functional product?
- venturecruelty 10mo agoTie it to quarterly performance results!
- llbbdd 10mo agoI don't use Github Pages so I might be wrong but IMO I think at least part of the joke is that its URL betrays that it's a completely static site.
- Tade0 10mo ago
- geophph 10mo agoIs GitHub deployed using GitHub Actions?
- Oakwhisper 10mo agoI was talking with some GH sales/marketing engineers last month and they said it deploys with actions, but they have a custom deploy queue
- 0cf8612b2e1e 10mo agoIt is a fun bootstrapping problem. How do you firewall enough dedicated resources to stand up your infrastructure if you dogfood your own product. Probably insidiously easy to have a dependency on the production service.
- shakna 10mo agoAn Azure outage took out Office365 the day before CrowdStrike happened. I would not trust Microsoft to get this balance right.
- Lapalux 10mo agoOh nice - I'm literally playing around with a site to detect outages for major provides (AWS/cloudflare/github) based on social media/HN posts
- Lapalux 10mo agohehe - thank you for helping me Github - https://imgur.com/a/0KqmKpU https://imgur.com/a/0KqmKpU
- llbbdd 10mo agoI've gotten accustomed lately to spending a lot of time in the Github Copilot / agent management page. In particular I've been having a lot of fun using agents to browse some of my decade-old throwaway projects; telling it to "setup playwright, write some tests, record screenshots/videos and commit them to the repo" works every time and it's a great way to browse memory lane without spending my own time getting some of these projects building and running again. However this means I'm now using the Github website and services 1000x more than I was previously, and they're trending towards having coin-flip uptime stats. If Github sold a $5000 box I could plug into a corner in my house and just use that entire experience locally I'd seriously consider it. I'm guessing maybe I could get partway there by spending twice that on a Mac Pro but I have no idea what the software stack would look like today. Is there a fully local equivalent out-of-the-box experience that anyone can vouch for? I've used local agents primarily through VSCode, but AFAIK that's limited to running a single active agent over your repo, and obviously limited by the constraints of running on a single M1 laptop I currently use. I know at least some people are managing local fleets of agents in some manner, but I really like how immensely easy Github has made it.
- bastardoperator 10mo agoThey do, it's called GHES. https://docs.github.com/en/enterprise-server@3.19/admin/overview/about-github-enterprise-server https://docs.github.com/en/enterprise-server@3.19/admin/over... "GitHub Enterprise Server is a self-hosted version of the GitHub platform"
- ModernMech 10mo agoI've tried getting this set up at my University, it was hell dealing with them. We ended up going with Gitlab.
- verst 10mo agoThat does not include the Copilot related APIs though.
- AceJohnny2 10mo agoyou're not getting copilot on the self-hosted version, which is what the parent was focusing on.
- doublerabbit 10mo agoI've not been able to browse any repo sources without the Unicorn for the past few hours.
- tonymet 10mo agoThis is pretty dishonest because some trivial service no one cares about will reset this counter .
- guywithabike 10mo agoYour definition of "trivial" is not everyone's definition of trivial.
- toastal 10mo agoThis is why I keep encouraging folks to a) have a mirror & b) make sure their tools automatically pick up the mirrors. I recently got mirror support upstreamed into Nixpkgs for fetchdarcs & fetchpijul which actually work on my just-alpha-released pinning tool, Nixtamal <https://darcs.toastal.in.th/nixtamal/trunk/README.rst https://darcs.toastal.in.th/nixtamal/trunk/README.rst>, for just this sort of thing.
- barbazoo 10mo agoI envy you. Most of us struggle to get the resources to make our actual customer facing applications resilient, let alone our build pipeline.
- toastal 10mo agoBuilding your software usually involves getting dependencies, & those dependencies are, hopefully, in more than one location—which includes a cronjob to a bare repo, or Alice’s fork on another repo that at least has the latest tags. It should be trivial to point to these as mirrors for the cases where any forge/repository, even the ones held by megacorporations, inevitably go down. Even Nixpkgs itself, while not maintaining their own official mirrors, are mirrored by TUNA. Backups are an important strategy, & the source code should also be a part of that.
- maccard 10mo agoThat's great for the repository, but what about if you're using ghcr, actions, issues, or copilot?
- toastal 10mo agoThese are different concerns. There are a lot of use cases, where folks are just getting dependencies & not interacting with bug tracker or continuous integration use which are less critical & can be accessed later or ran locally.
- ferguess_k 10mo agoI guess none of us really needs those 9s, and even two 9s are just good enough. I even doubt whether *SOME* of the banking transactions really really really need those 9s too -- like, I don't really mind if 1 out of 100 credit payment doesn't go through so I have to do it again -- it does happen once for a while and I just swiped it again.
- 0xdeafbeef 10mo agoRetry is fine, but imagine being unable to pay for something within 10 minutes in month. And 10m in 1M is 99.98% sla. So it depends
- dec0dedab0de 10mo agoI had an ATM glitch out on me a few months ago, I tried again and it confiscated my card. I called, and they explained that it is the failure mode to prevent people modifying them while they're offline.
- tormeh 10mo agoGitHub has a container registry. That going down can cause pod start failure. I agree the source code probably doesn't need infinite nines, but the container registry is different.
- mystifyingpoi 10mo agoWhich should not even be that hard, because read-only replicas of artifact repos are trivial to create and easy to loadbalance.
- cedws 10mo agoI found out when Actions started failing again for the Nth time this month. The internal conversation about moving away from Actions or possibly GitHub has been triggered. I didn't like Zig's post about leaving GitHub because it felt immature, but they weren't wrong. It's decaying.
- deleted 10mo ago[deleted]
- DetroitThrow 10mo agoCombined with security concerns, this made us reconsider even our self-hosted GH Actions last month. GH Packages is something we're extricating ourselves from after today too. One more outage in the next year and maybe we get the ammunition to move away from GH entirely. It's still hard to believe that they couldn't even keep the lights on on this thing.
- IgorPartola 10mo agoThe Zig post has since been updated and the objectionable parts have been removed. I think we can put that part to rest.
- landr0id 10mo agoI have no problem with their opinions but I don’t think it should have been said in a Foundation post. It may have been updated, but nobody is reading the update.
- 10mo ago
- samcheng 10mo agoMissed a chance to put this in meme format e.g. https://imgflip.com/memetemplate/439302803/Days-without-accident-cleaned https://imgflip.com/memetemplate/439302803/Days-without-acci...
- lawlessone 10mo agoThe amazing part about this is the page even works when i'm offline.
- queuebert 10mo agoAt this point, is there any downside to switching to GitLab?
- loloquwowndueo 10mo agoWhat’s gitlab? (Snarky way of saying: GitHub still has huge mindshare and networking effects, dealing with another forge is probably too much friction for a lot of projects) Not that GitHub doesn’t suck…
- burningChrome 10mo agoWhen GitHub was bought by Microsoft, Gitlab made moving your repos to them super easy. Apparently not enough people have moved and it would seem even with sustained attacks from all kinds of different vectors, it would seem people continue to stick with them. I use both Gitlab and Github and have yet to experience any downtime on any of my stuff. I do however, work at a large corporation and the latest NPM bug that hit Github caused enough of a stir where it basically shut down development in all of our lower environments for about two weeks so there's that. But I do agree, and it seems like their market share increased after the Microsoft acquisition which is contrary to what I heard in all my dev circles because of how uncool MSFT is to many of my friends.
- richardwhiuk 10mo agoIs the uptime any better?
- burningChrome 10mo agoNot really: GitHub - Historically, GitHub reports uptime around 99.95% or higher, which translates to roughly 20–25 minutes of downtime per month. They have a large infrastructure and redundancy, so outages are rare but can happen during major incidents. GitLab - GitLab also targets 99.95% uptime for its SaaS offering (GitLab.com). However, GitLab has had slightly more frequent service disruptions compared to GitHub in the past, especially during scaling events or major upgrades. For self-hosted GitLab instances, uptime depends heavily on your own infrastructure.
- matheusmoreira 10mo agoI've been getting some weird cryptocurrency spam notifications on GitHub and they can't be cleared for some reason. Blue dot is gonna be there forever apparently. Some users made an issue out of it but nobody cared to fix it.
- fastball 10mo agoSame happened to me. You can clear it via the CLI, hilariously. ``` gh api notifications\?all=true | jq -r 'map(select(.unread) | .id)[]' | xargs -L1 sh -c 'gh api -X PATCH notifications/threads/$0' ```
- bdcravens 10mo agoHN doesn't support markdown, but you can "code" format it with 2+ spaces. https://news.ycombinator.com/formatdoc https://news.ycombinator.com/formatdoc
- dennis-tra 10mo agoHad the same issue that the blue dot won’t disappear. I was able to clear the dot with: gh api notifications -X PUT -F last_read_at=2025-10-06T00:00:00Z Just change the date to today. I also got that line from a gh issue somewhere - maybe it was the same issue that you’re referring to.
- cassidoo 10mo agoThis should have been fixed here: https://github.blog/changelog/2025-12-04-notifications-triggered-by-spam-accounts-are-now-correctly-hidden/ https://github.blog/changelog/2025-12-04-notifications-trigg... Are you still seeing it, would you mind checking? Our team will get on it if so.
- shakna 10mo agoI had the same. The dot is cleared on the mobile site. It is present on the desktop site.
- deleted 10mo ago[deleted]
- Aperocky 10mo agoOnce GitHub fully migrates to Azure, it should be known as GitHub 11.
- ragall 10mo agoGithub 3.11 for Workgroups.
- aranw 10mo agoGitHub Vista Cloud Edition
- doubled112 10mo agoAfter a couple of service packs will it be OK?
- Gazoche 10mo agoI think you mean "365 Code Copilot".
- Aperocky 10mo agoAgenticHub!
- TuxPowered 10mo agoIt should always be at 0, because GitHub is unreachable over IPv6, which in 2025 should be considered an incident.
- tonymet 10mo agomobile adoption is high, desktop (residential and corporate) is still quite low. I'm a big advocate for github to add ipv6 support , but let's not pretend it's critical for their business.
- pas 10mo agojust a few hours ago we found a pretty nice residential desktop use case for proper v6 (with prefix delegation), due to no need for NAT the old router (2013) became less of a bottleneck!
- tonymet 10mo agoDouble check (I mean by remote port scan) that your firewall is working. I’ve seen routers with no IPv6 firewall . And it actually matters
- kalleboo 10mo agoAren't there serveral hosts now where IPv6 access is included but you have to pay for each attached IPv4? E.g. AWS and Hetzner
- tonymet 10mo agoYep
- fragmede 10mo ago"yeah but when I turn on ipv6 everything breaks"
- doubled112 10mo agoI haven’t had a residential ISP that provided IPv6 yet.
- locusofself 10mo agoThe Primagen video about the bash scripts underpinning github actions runner was crazy. I'm a half-assed programmer at best and I don't even think I would make some of those mistakes.
- OptionOfT 10mo agoGitHub Actions is a good example of systems thrown together that at face value have something to offer until they get put under stress. Just now I found: * a job that's > 1 month old, still running * another job that started 2 hours ago that had 0 output * a job that was marked as pending, yet I could rerun it * auto-merges that don't happen * pull requests show (1), click it, no pull requests visible Makes me wonder in how many places state is stored, because there is some serious disconnect between them.
- Nextgrid 10mo agoThat's just post-Windows 8 Microsoft quality for you. Every product has been like that - looks "ok" on the outside (in reality it looks shit, but at least that's intentional), but the second you dig deeper and start using it you get all kinds of paper cuts like that.
- Ozymandias-9 10mo agoWhen I opened the link, I just laughed for 5 mins straight