8 ms·
> or in computer science / applied math/stats / etc., with different codebases, with different model variants, on different datasets) and the overall conclusion
by throwawaygh 6y ago
> or in computer science / applied math/stats / etc., with different codebases, with different model variants, on different datasets) and the overall conclusions hold
A lot of open sourced CS research is not reproducible.
"the code still runs and gives the same output" is not the same as reproducibility.
- throwaway287391 6y ago> A lot of open sourced CS research is not reproducible. I'm not sure if this was meant to be a counter-argument to me, but I completely agree! > "the code still runs and gives the same output" is not the same as reproducibility. Yes, bit-for-bit identical results are neither necessary nor sufficient for reproducibility in the usual scientific sense.
- throwawaygh 6y ago> I'm not sure if this was meant to be a counter-argument to me It wasn't :)