6 ms·

I work in academia and have over 70 papers published. I Agree with most ideas in the article. Another dimension not covered is what I called “author engineeri

• fl4tul4 1y ago
  That's not the way science is supposed to work...
  • tux3 1y ago
    And there's more where that came from. This particular sausage is made with tragically messed up incentives, and people will naturally always optimize the framework you put them in. Thankfully the scientific process is incredibly resilient to nonsense, because a bad result will eventually screw up someone's future work when they come to rely on it. But it's not pretty.
    • isaacremuant 1y ago
      > because a bad result will eventually screw up someone's future Not if they isolate themselves enough from the outcome but I get what you're saying. The world progresses despite these deeply flawed institutions (corporations or academia have these perverse incentive problems and all in all, they do create some value on average).
  • isaacremuant 1y ago
    But in practice it absolutely is how the academic world works. Is politics all the way down. Which is why it's so funny when you see non skeptical appeals to "the god of science" which apparently exists in a vacuum of correctness and ethical purity.
  • 317070 1y ago
    It's a pet peeve of mine, but "publications" and "peer-review" are not really part of the scientific process? Just like "academia" they have kind of grown onto the term, almost claiming it for their own. I find that a sad evolution. The most fun in science can be had when done at home and shared with friends.
    • bgnn 1y ago
      This! Academia != science. It is a social construct and dominated by people with power within a given field. That being said, double blind review process improved the author engineering problem a lot.
  • intended 1y ago
    Platonic ideal, meet human reality. As long as It has some capacity to self correct, it’s a stable function.
  • bonoboTP 1y ago
    It never really worked otherwise. Even before formal peer review and journals, social standing and political squabbling, finding patrons etc. definitely affected science. The grade school textbook ideal version is a literal lie-to-children. The problem is that threading the needle correctly, without falling over to the other side, of quackery and "the academic mafia is suppressing this perpetual motion machine" and "Big Science" doesn't want to admit that ESP exists etc. can be incredibly hard.
    • a123b456c 1y ago
      Every human endeavour reflects common human behaviors. Large groups of humans do not interact without political considerations arising. Science has a few aspects that are distinct from non-Science enterprises, but more aspects in common.
  • gbacon 1y ago
    The author elsewhere cautions “I write this because PhDs seem to attract a lot of smart, idealistic kids who are interested in doing Science 1 and don’t realize that they’ve signed up to do Science 2.” https://maxwellforbes.com/posts/dont-try-to-reform-science/ https://maxwellforbes.com/posts/dont-try-to-reform-science/
• nicce 1y ago
  I thought that blind peer-reviews solved this?
  • bonoboTP 1y ago
    Yes, with some caveats. Sometimes people can guess where a paper comes from based on the used datasets, even graphic design style, a skew in cited papers. Also, often people upload the preprint to Arxiv and so the reviewer may have seen the non-anonymous version already. Also, the having someone within the community among the authors will help with formulating the paper in a way that this community expects it. With the right turns of phrase, citing and praising those related works that are seen highly in the community, using the tone that is usual in the community etc. People should ideally try to counteract such biases in themselves, but humans are tribal and social. Especially if you scale this to tens of thousands of people, the average won't be a saint. People have careers, graduations, promotions, visas, green cards, job prospects, friendships and generally social standing in their professional community on the line. Academics aren't any more holy than people in finance, or politics or entertainment or startups or other ruthless and social-game heavy environments.
  • dagw 1y ago
    My wife works in a fairly niche field and can often guess at the very least which university or research group a blind paper is from, and quite often the author (or in the case of a PhD student, the authors supervisor).
    • karmakurtisaani 1y ago
      But if they can't, surely they won't reject the paper because of that?
    • techas 1y ago
      True. But that opens the game of writing a paper “with the style of” someone known and get accepted. Its a gamble game… for authors and reviewers.
  • techas 1y ago
• Majromax 1y ago
  > Many times it is very difficult to “get into” a new field if you don’t have an author known by the editors. Although there's plenty of critique to go around about the review system, machine learning here typically uses double-blind peer review for the major conferences. That blinding is often imperfect (e.g. if a paper very obviously uses a dataset or cluster proprietary to a major company), but it's not precise enough to reject a paper based on the author being an unknown.