5 ms·

Open, rigorous and reproducible research: A practitioner’s handbook (2021)

277 points by sieste 3y ago

tasubotadas 3y ago
Anyone used it? Is it any good?
- baka367 3y ago
  It feels like a great material at explaining the field to new joiners. My team is currently migrating from software to data science and this publication feels exactly like something that would bridge the gap
  - nerdponx 3y ago
    What company do you work at where they're willing to train a bunch of developers up to data science from scratch? That's a multi-year investment if you want a team that can actually solve real problems without causing more problems.
    - shapefrog 3y ago
      data science isnt that hard!
      - mjburgess 3y ago
        Well, it's mostly impossible -- i guess that's a certain sort of way it isnt hard.
      - nerdponx 3y ago
        It's not hard in the same way software engineering isn't hard. That is to say: it's hard to do well.
troelsSteegin 3y ago
The page embeds https://stanforddatascience.github.io/best-practices/index.html https://stanforddatascience.github.io/best-practices/index.h...
- deleted 3y ago
  [deleted]
- hackernewds 3y ago
  Would be helpful to feed into custom chatgpt that ask the gpt questions directly
  - bazmattaz 3y ago
    I just tried that but there is pagination. Would love to know if we can instruct GPT4 to click through the pages
- jiriro 3y ago
  Oh, thank you. The original covers almost 50% of the screen (iphone) with the static heading!
- dang 3y ago
  Ok, we've changed to that from https://datascience.stanford.edu/programs/stanford-data-science-scholars-program/data-science-handbook https://datascience.stanford.edu/programs/stanford-data-scie... above. Thanks!
alwaysrunning 3y ago
[flagged]
- HFguy 3y ago
  Stanford is a big place. Would not disregard all the work from anyone connected just because of something the president did.
  - alwaysrunning 3y ago
    See my comment above, I am sure there are great ppl that work there but the timing?
    - hackernewds 3y ago
      should I wait 2 years then it's fine to use the data science handbook for my interview prep?
- simonw 3y ago
  I genuinely don't see how that's relevant here. Are you saying that if a president of a university is caught doing something bad and fired/resigns for it then every piece of output from that university related to that field should be disregarded?
  - alwaysrunning 3y ago
    I'm saying the timing is not the best. Read the room first. And I'm not saying he "was caught doing something bad" I am saying he is the President of the university, the leader, and he is a fraud. This isn't a one-time thing, and this fraud stretches back to before he was president, there were already rumors of his fraud in his community, and they hired him anyway knowing he could be a fraud. He also worked to stop this from coming to light, and to this day hasn't really admitted he was at fault except to say 'I could have done better', he is also stil a professor there. A 17 yo can figure this out but a university board can't? come on. "Marc Tessier-Lavigne, who has spent seven years as president, authored 12 reports that contained falsified information" What kind of legal threats did you receive? Stephen Neal, the chair emeritus of Cooley, one of the biggest law firms in the Silicon Valley area, represented Marc Tessier-Lavigne and sent a number of aggressive letters requesting retractions or seeking to block the publication of articles that detailed Tessier-Lavigne’s involvement in alleged incidents of fraud. Neal is also a former attorney for [disgraced former Theranos CEO] Elizabeth Holmes. https://www.latimes.com/science/story/2023-07-21/how-stanford-freshman-brought-down-university-president https://www.latimes.com/science/story/2023-07-21/how-stanfor...
hackernewds 3y ago
"In summary, this handbook is a guide to making science more open, transparent, and reproducible by presenting best practices"
- deleted 3y ago
  [deleted]
ulrischa 3y ago
Very cool that universities like Stanford that usually costs a lot of money offer their study material for free
deleted 3y ago
[deleted]
necrophcodr 3y ago
> While recording the versions of all packages used is a step in the right direction, an even more comprehensive solution is to package up the entire environment using something like Docker, or to use online computation, such as Google’s colaboratory notebooks. An even better way would be to describe the environment using Guix with channels or something similar accompanying the code, or a Nix flake or any similar environment descriptions with fully fixed dependency chains. Docker can be _forced_ to use a fixed version, but any `apt update` will ruin that completely, and both Nix and Guix are tools that on top of providing these environments for executing code with the same set and versions of tools, also provide the ability to generate container images that can be shared.

277 points by sieste 3y ago

tasubotadas 3y ago

Anyone used it? Is it any good?

baka367 3y ago
It feels like a great material at explaining the field to new joiners. My team is currently migrating from software to data science and this publication feels exactly like something that would bridge the gap
- nerdponx 3y ago
  What company do you work at where they're willing to train a bunch of developers up to data science from scratch? That's a multi-year investment if you want a team that can actually solve real problems without causing more problems.
  - shapefrog 3y ago
    data science isnt that hard!
    - mjburgess 3y ago
      Well, it's mostly impossible -- i guess that's a certain sort of way it isnt hard.
    - nerdponx 3y ago
      It's not hard in the same way software engineering isn't hard. That is to say: it's hard to do well.

troelsSteegin 3y ago

The page embeds https://stanforddatascience.github.io/best-practices/index.html https://stanforddatascience.github.io/best-practices/index.h...

deleted 3y ago
[deleted]
hackernewds 3y ago
Would be helpful to feed into custom chatgpt that ask the gpt questions directly
- bazmattaz 3y ago
  I just tried that but there is pagination. Would love to know if we can instruct GPT4 to click through the pages
jiriro 3y ago
Oh, thank you. The original covers almost 50% of the screen (iphone) with the static heading!
dang 3y ago
Ok, we've changed to that from https://datascience.stanford.edu/programs/stanford-data-science-scholars-program/data-science-handbook https://datascience.stanford.edu/programs/stanford-data-scie... above. Thanks!

alwaysrunning 3y ago

[flagged]

HFguy 3y ago
Stanford is a big place. Would not disregard all the work from anyone connected just because of something the president did.
- alwaysrunning 3y ago
  See my comment above, I am sure there are great ppl that work there but the timing?
  - hackernewds 3y ago
    should I wait 2 years then it's fine to use the data science handbook for my interview prep?
simonw 3y ago
I genuinely don't see how that's relevant here. Are you saying that if a president of a university is caught doing something bad and fired/resigns for it then every piece of output from that university related to that field should be disregarded?
- alwaysrunning 3y ago
  I'm saying the timing is not the best. Read the room first. And I'm not saying he "was caught doing something bad" I am saying he is the President of the university, the leader, and he is a fraud. This isn't a one-time thing, and this fraud stretches back to before he was president, there were already rumors of his fraud in his community, and they hired him anyway knowing he could be a fraud. He also worked to stop this from coming to light, and to this day hasn't really admitted he was at fault except to say 'I could have done better', he is also stil a professor there. A 17 yo can figure this out but a university board can't? come on. "Marc Tessier-Lavigne, who has spent seven years as president, authored 12 reports that contained falsified information" What kind of legal threats did you receive? Stephen Neal, the chair emeritus of Cooley, one of the biggest law firms in the Silicon Valley area, represented Marc Tessier-Lavigne and sent a number of aggressive letters requesting retractions or seeking to block the publication of articles that detailed Tessier-Lavigne’s involvement in alleged incidents of fraud. Neal is also a former attorney for [disgraced former Theranos CEO] Elizabeth Holmes. https://www.latimes.com/science/story/2023-07-21/how-stanford-freshman-brought-down-university-president https://www.latimes.com/science/story/2023-07-21/how-stanfor...

hackernewds 3y ago

"In summary, this handbook is a guide to making science more open, transparent, and reproducible by presenting best practices"

deleted 3y ago
[deleted]

ulrischa 3y ago

Very cool that universities like Stanford that usually costs a lot of money offer their study material for free

deleted 3y ago

[deleted]

necrophcodr 3y ago

> While recording the versions of all packages used is a step in the right direction, an even more comprehensive solution is to package up the entire environment using something like Docker, or to use online computation, such as Google’s colaboratory notebooks. An even better way would be to describe the environment using Guix with channels or something similar accompanying the code, or a Nix flake or any similar environment descriptions with fully fixed dependency chains. Docker can be _forced_ to use a fixed version, but any `apt update` will ruin that completely, and both Nix and Guix are tools that on top of providing these environments for executing code with the same set and versions of tools, also provide the ability to generate container images that can be shared.