3 ms·
There's a shell script version of GNU parallel that's great for CI/CD pipeline tasks. You just keep it in your repo and source it as needed. It's incredibly use
by bloopernova 3y ago
There's a shell script version of GNU parallel that's great for CI/CD pipeline tasks. You just keep it in your repo and source it as needed. It's incredibly useful, we use it in one build to batch process a few thousand things in groups of 25.
Edited to add: finally got signed in to work, you create the script via:
parallel --embed > scriptname.sh
It's about 14,000 lines of awesome and works on "ash, bash, dash, ksh, sh, and zsh"
- deleted 3y ago[deleted]
- notpachet 3y agoMaybe this is a silly question, but what advantage do you get from checking that huge file into VC instead of just installing parallel ahead of time on the CI images?
- ilyt 3y agoParallel was born way before docker and modern CI practices. Having one script that did it all was more of a benefit before those become commonplace
- bloopernova 3y agoNot a silly question! In this case, we don't have control over the docker images used to build our apps.