4 ms·
I fully agree and try to do that in my research, but it's very hard to do 100%. I just wrapped up a 1.5-year computational research project, and we have all the
by jhrmnn 6y ago
I fully agree and try to do that in my research, but it's very hard to do 100%. I just wrapped up a 1.5-year computational research project, and we have all the raw and processed data, the main code, the processing scripts, the notebook that generates the figures, etc. But it's still not a fully automated pipeline. The missing pieces:
• Some older calculations were run with somewhat older versions of the code. Of course we believe that the results wouldn't change, and we recalculated some, but not all. We didn't keep track of exactly which version was used for which calculations, because that's simply very demanding in the middle of a complex research project.
• Some data in the text and tables of the paper are still extracted manually from the code. We don't have a full templating system where the data could be automatically inserted into the paper. You could use something like Jinja to do it, but then every coauthor needs to have high technical skills and it's just time-consuming to maintain in general.
- haihaibye 6y ago> We didn't keep track of exactly which version was used for which calculations, because that's simply very demanding in the middle of a complex research project. Doing the bare necessities of science (recording methods for results) can be almost automated: Put all code in Git then in your script add something like: git rev-parse HEAD >> run.log