First, reproducibility is a spectrum, from a simple recipe to run `make` and get a byte-for-byte reproduction. A cookie recipe is reproducible - follow these s

First, reproducibility is a spectrum, from a simple recipe to run `make` and get a byte-for-byte reproduction. A cookie recipe is reproducible - follow these steps and get tasty cookies. But will they be the tastiest cookies? For that, you need more detail, but the write-ups almost never have the full story. Having put dozens of academic ML algos into production, anything short of `make reproduce` which bare minimum gives you a table of results on some validation subset, is merely reproducible-ish. Not having vcs cause it's "hard" is straight-up slacking (use svn if git is too hard).