10 ms·
A short while ago (eh, just noticed this was over a year ago...) I did a comparison between different testing solutions for all projects within the IPFS organiz
by diggan 9y ago
A short while ago (eh, just noticed this was over a year ago...) I did a comparison between different testing solutions for all projects within the IPFS organization. Remember this was a year ago, so many things have changed but we ended up going with Jenkins and I'm now migrating projects from free usage of Travis/CircleCI to Jenkins.
- Brief explanation: https://github.com/ipfs/infrastructure/issues/100#issuecomment-265439892 https://github.com/ipfs/infrastructure/issues/100#issuecomme...
- Spreadsheet comparing features: https://docs.google.com/spreadsheets/d/11kTloM6d1CGu_ycmP3XzpteGpJtij-h6q07anM5ZuGs/edit#gid=0 https://docs.google.com/spreadsheets/d/11kTloM6d1CGu_ycmP3Xz...
Check out those links and you should get a good overview
- boleary-gl 9y ago"Haven't really found any good way of integrating the Gitlab-CI with Github" Sounds like that is solved.
- smulc 9y agoNice summary. Did you test support for handling multiple changes to a single project in parallel? The only CI Platform I've found that tries to handle this in any meaningful way is OpenStack Zuul (https://zuul-ci.org/ https://zuul-ci.org/) and https://docs.openstack.org/infra/zuul/user/gating.html#testing-in-parallel https://docs.openstack.org/infra/zuul/user/gating.html#testi... for details of the parallel support. Do others have this need? Or are people generally focusing on keeping CI runs short and landing changes in a serial fashion?
- diggan 9y agoNo, this was not a consideration, as we often have so many PRs open at one time, that this is probably not feasible. If I understand the process correctly, it would merge each PR in order from the first made until the most recent one. So the most recent one includes all the proposed changes. For ipfs/go-ipfs, that would involve doing 104 tests + builds for each PR. Rather, we test each branch as it was merged into master (in isolation), and when master changes, trigger builds for PRs that now are changed. The "Cross Project Testing" and "Cross-Project Dependencies" is something we're deeply in need of though, and already do somewhat. The dependencies are implicit now though (via npm or our golang package manager, gx) rather than explicit. If anyone have ideas for "cross project testing with dependencies" on Jenkins, I would be very happy to hear them.
- kkapelon 9y agoVery Nice! I did something similar but only for hosted solutions http://blog.codepipes.com/hosted-ci-comparison/hosted-ci-comparison.html http://blog.codepipes.com/hosted-ci-comparison/hosted-ci-com... I am preparing another blog post for on-premise (GoCD, Jenkins, Concourse etc.)