This is great! I feel this is the missing guide we should have referred to, in our recent writeup: "Software Engineering for Scientific Big Data Analysis" - h

This is great! I feel this is the missing guide we should have referred to, in our recent writeup: "Software Engineering for Scientific Big Data Analysis" - https://doi.org/10.1093/gigascience/giz054 https://doi.org/10.1093/gigascience/giz054 We were touching on the issue in point 1 in that paper, and did have a discussion about it internally, but this guide really takes a holistic view on the problem. Thinking about all of this, I'm also happy we managed to build our workflow manager SciPipe (http://scipipe.org http://scipipe.org) completely without code-level dependencies :)