4 ms·

> He is asking that researchers produce code that he can put into production. That's not how I read his comments at all. What he seems to be asking for is the

by ilyanep 10y ago

> He is asking that researchers produce code that he can put into production. That's not how I read his comments at all. What he seems to be asking for is the ability to take the code you used to produce the pretty graphs and tables in your paper and re-run it, maybe tweak it himself and use it on a slightly different dataset. He wants to be able to see that your results extend to more than just the toy synthetic dataset you made up, and also be able to verify that some bug in your verification code didn't make the results seem more successful. Finally, he wants to be able to compare apples-to-apples by knowing all the details of your procedure that you didn't bother putting into the paper. (Impersonal you, of course)

kardos 10y ago
> What he seems to be asking for is the ability to take the code you used to produce the pretty graphs and tables in your paper and re-run it, You're assuming such code exists. If the graphs were produced by hand (eg, typing things into MATLAB to create the plot and then saving the figure), then there is no code to hand off. Now the code request has risen to "redo all that work".
- Certhas 10y ago
  And, as an academic myself, we should force people to save and publish their matlab scripts. That is not to much to ask, but the academic system is full of perverse incentives. Doing good, robust work looses to good looking, quick and dirty all the time. We need funding bodies to require publication of all these details, and we need to structurally combat publish or perish. Hire people based on their three best results, not on h-factor or other statistical meassures.
- tremon 10y ago
  How is "typing things into MATLAB" not code?
  - kardos 10y ago
    Some (many?) use MATLAB interactively to produce figures and then save them by hand. Often this involves a mixture of typing commands and clicking on GUI elements like "add colorbar". So a m-file that produces the figure doesn't exist; at best there would be fragments of code buried in MATLAB's command history.
  - tedmiston 10y ago
    That sounded to me like a reference to using the REPL + GUI in an interactive session vs. writing a code file that is saved.

by ilyanep 10y ago

kardos 10y ago

> What he seems to be asking for is the ability to take the code you used to produce the pretty graphs and tables in your paper and re-run it, You're assuming such code exists. If the graphs were produced by hand (eg, typing things into MATLAB to create the plot and then saving the figure), then there is no code to hand off. Now the code request has risen to "redo all that work".

Certhas 10y ago
And, as an academic myself, we should force people to save and publish their matlab scripts. That is not to much to ask, but the academic system is full of perverse incentives. Doing good, robust work looses to good looking, quick and dirty all the time. We need funding bodies to require publication of all these details, and we need to structurally combat publish or perish. Hire people based on their three best results, not on h-factor or other statistical meassures.
tremon 10y ago
How is "typing things into MATLAB" not code?
- kardos 10y ago
  Some (many?) use MATLAB interactively to produce figures and then save them by hand. Often this involves a mixture of typing commands and clicking on GUI elements like "add colorbar". So a m-file that produces the figure doesn't exist; at best there would be fragments of code buried in MATLAB's command history.
- tedmiston 10y ago
  That sounded to me like a reference to using the REPL + GUI in an interactive session vs. writing a code file that is saved.