3 ms·
"I would be astounded if scientists routinely actually committed to paper an exhaustive list of all the software installed on the computer they did the math on.
by jimbokun 17y ago
"I would be astounded if scientists routinely actually committed to paper an exhaustive list of all the software installed on the computer they did the math on. (What version of which library, etc etc. So you can reproduce bugs.)"
This shouldn't be necessary, of course. The raw data and a description of the algorithms (with sufficient latex-y equations) should suffice. If not, I don't think the paper is worth much.
I think, though, this is what you meant by:
"Nobody is ever going to try to actually duplicate the math it took to transform your raw data into your massaged data -- that is hard work"
But that is exactly what must happen for anyone to claim they have reproduced the original results. If you just get a VMWare instance of the original author's computer, run his program and get the same results you still are no closer to knowing whether he made a mistake or not.