4 ms·
We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" No idea if/when we decide to pull that bandaid but I think onc
by beardedetim 3mo ago
We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?"
No idea if/when we decide to pull that bandaid but I think once we can't merge a hot fix into main because of GH being down, it'll be a big org push to replace it.
What's everyone else using? Self hosted Gitlab? Gitea?
- drno123 3mo agoSelf hosted Gitea
- newswasboring 3mo agoWhen you self host, what happens with your compute costs? CI can be super expensive depending upon your test pipeline. Do you end up spending more than you would with GitHub actions for example?
- Maxion 3mo agoHuh? The VPS boxes have a fixed monthly fee
- applidhumanco 3mo agoHe is likely referring to the CI runners. Gitea has their own version of Actions runner. It is very much usable, though currently inferior to GitHub Actions (not always a 1:1 replacement, even though they aim for it to be): https://docs.gitea.com/usage/actions/ https://docs.gitea.com/usage/actions/ Cost as always depends on your usage, but it will likely be less than your current cost of GitHub Actions.
- newswasboring 3mo agoThank you. This is exactly what I meant. I work for a large company where our testing budget is massive and most of it goes towards these CI runners. Provisioning enough and consistent compute for testing pipelines sometimes becomes the bane of my existence.
- Maxion 3mo agoI can recommend that you self-host Jenkins on another box.
- JoshStrobl 3mo agoJust get some x86 and ARM runners off netcup, manage Woodpecker CI + Woodpecker Agent. Generally pretty hands-off once you get it set up. That plus a cheap VPS running Forgejo with postgres off-site backups, you are looking at a small fraction of the cost compared to per-seat GitHub pricing for orgs + Action Minutes.
- elric 3mo ago> We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" Did you have the conversation "do we need to move from $whatever CI/CD to GitHub Actions?" beforehand? What were the arguments in favour?
- beardedetim 3mo agoIt's a ~year old product that started on GH. So this is the first time this team has had to think through "okay, so this isn't as reliable as it was at $oldjob."
- Macha 3mo agoNot the same company but similar discussions here: - It was believed that GitHub would be more reliable than our self hosted Gitlab CI runners. This has proven to be very false. - It was believed it would be easier to write tooling. I’m not on the dev tooling team, so can’t confirm if they found it true or not, but from the outside I see a lot more “Github can’t do that” than I did “Gitlab can’t do it”
- Normal_gaussian 3mo agoThose are both hilarious to me. In my last FTE role we had the exact opposite beliefs - we wanted to leave GitLabs increases in pricing and move to annual sub, but the reliability of self-hosted runners and the flexibility (and clarity) of the CI system was fantastic.
- dataengineer56 3mo ago> Those are both hilarious to me. Why is it hilarious to believe that the industry leader might be better at something than doing it yourself?
- deleted 3mo ago[deleted]
- 3mo ago
- qweqwe14 3mo agoSelf-hosted GitLab and self-hosted GitLab Runners (Omnibus Docker image)
- nerdypepper 3mo ago> What's everyone else using? Self hosted Gitlab? Gitea? tangled.org!
- classified 3mo agoI'm completely untangled. From GitHub.
- http-teapot 3mo agoWhat's your experience with tangled? Would love to hear the experience from other users as well
- MarkBennett 3mo agoIt's worked great for hosting my smaller personal projects so far, and I've already received a few helpful pull requests from the community. Tangled.org really been working to ensure all their features work from data hosted on your personal data server (it's based on ATproto) which means should their performance, reliability, or monetization ever get you down it's easy to switch to a competitor since you're not locked in.
- lsuresh 3mo agoWe use self-hosted Github runners, but it's a moot point if all of Github is mostly down as is the case right now. :\
- c2403 3mo agoHave you considered Codeberg?
- sscaryterry 3mo agoDifferent set of ideologies completely, not an alternative.
- 6031769 3mo agoAn alternative set of ideologies is part of what makes it ... an alternative! I mean, that plus better uptime.
- Macha 3mo agoI remember in 2024 passing over codeberg as the host for some of my personal projects because of the uptime. I don’t think Codeberg’s uptime has gotten any better but despite that it’s getting a lead over GitHub now.
- sscaryterry 3mo agoIts about freedom, which codeberg are supposed to be proponents of. Turns out, they're no better than github :) See: https://blog.codeberg.org/protecting-our-floss-commons-from-llms.html https://blog.codeberg.org/protecting-our-floss-commons-from-...
- layer8 3mo agoSelf-hosted GitLab at work, self-hosted Gitea at home.
- speleding 3mo agoIf your app is not too large you can do CI/CD perfectly fine from your laptop. Put it in a docker container if you want to ensure it is perfectly reproducible. You still need Github as the origin repo to pull from, but the "git part" of GitHub seems to be (almost) always up and running. (We use "capistrano" for this)
- cesarb 3mo ago> If your app is not too large you can do CI/CD perfectly fine from your laptop. Not if you want to make sure it compiles and works on Windows (which you don't have) or macOS (which you don't have and can't emulate). That's something github gives for free, and for me, it's the only reason to stay on github for small/tiny free software projects (at least as a secondary host).
- latchkey 3mo agoblacksmith.sh just raised tens of millions on the core premise that self-hosting CI/CD is hard [0]. they've had multiple outages in the last week, so i guess they are proving themselves correct. in practice, giving ssh/sudo to AI (codex) and telling it to setup ephemeral self-hosted runners on your own host VM (qemu), takes about 30 minutes and works extremely well. it bangs out all the shell scripts. moved my own business over to it. zero problems. you might even find it is kind of neat too. you can customize your VM with software pre-installed. speeds up your builds quite a bit. [0] https://www.blacksmith.sh/blog/blacksmith-seed-announcement https://www.blacksmith.sh/blog/blacksmith-seed-announcement
- badgersnake 3mo agoTeamCity
- stephenway 3mo agoIf you're seriously looking at Gitea/Forgejo, I run Fjord, dedicated managed Forgejo, so you don't have to operate it yourself. We can help with migration and runners too. We also run a free public Forgejo instance if you just want to kick the tires first.
- pojntfx 3mo agoThank you for your work on Fjord! We're currently evaluating it vs. self-hosting, the comparison at https://fjord.sh/compare https://fjord.sh/compare has been very useful
- stephenway 3mo agoThat's really good to hear, thank you. If you run into anything that's unclear while comparing the two, I'd genuinely like to hear it. Happy to answer questions here too.
- dcan 3mo agoSelf hosted Gitlab at work with local runners
- mitchjj 3mo agoWorth being upfront with, I'm an employee, but; Buildkite. Frontier labs and global saas heavyweights run CI through us, plus a crop of open source tooling like Bazel, vLLM, Firecracker, Rails, Ray, Sorbet and Rust. Shopify, Uber, Airbnb, Canva stresstested the platform ten years ago for scaling issues. You need to take a little time to design upfront and take advantage of dynamically programmable primitives. It isn't the same ease/convenience as Actions. Bit more available though.
- tom1337 3mo agoHow would I be able to run my CI via Buildkite when I still host in GitHub and their API is down? We are currently already using self-hosted runners and they also don't work because either they aren't started by GitHub or can't download the code.
- maccard 3mo agoWe ran a mirror of our git repo on codecommit when things started to get really hairy, and pointed out CI to that instead of GitHub. It’s still a moving target though as we were using GitHub releases to publish to. We replaced that with an s3 bucket and mirrored _those_ to GH via actions, which had the added benefit of only failing when GitHub was down!
- maccard 3mo agoI want to second build kite - it’s an excellent piece of tech and is best described as “sane Jenkins” as a compliment. My only gripe is the pricing - it’s not designed for “small teams”. But I’d use it again in a heartbeat.
- mitchjj 3mo agoThis week we've released a free plan and overhauled the mid-tier; am keen to hear whether this alleviates the 'small team' pain against others in market
- 3mo ago
- nerdypepper 3mo agoultimately, folks need to stop writing massive YAML files to define their builds. CI should schedule jobs, your build system should define them. my workflow files look like this: steps: name: Do the thing run: nix build .# at any point, if my CI is down or i need to switch or i need to run builds locally, i can do so trivially.
- Norfair 3mo agoNixCI does this but with a built-in cache ;) https://nix-ci.com/comparison/github-actions https://nix-ci.com/comparison/github-actions
- jon_adler 3mo agoMy CI runner just calls make targets, that can easily be run locally if needed.
- maccard 3mo agoThis is all well and good until you need a cache, or credentials, or to pass data between steps, or to parallelize across runners.
- jscd 3mo agoIt's not the most elegant thing ever, but I've been using (self-hosted) WoodpeckerCI and it's been dead simple. It doesn't have many bells and whistles, but honestly I think that's good. Forced me to put complex behavior in better systems as opposed to doing bash scripts in YAML.
- baconslices 3mo ago>What's everyone else using? Self hosted Gitlab? Gitea? Self hosted github enterprise and runners.