3 ms·
As somebody in computational biology, I think it's important to note that a ton of cellular biology and even computational biology is "not reproducible." This c
by epistasis 5y ago
As somebody in computational biology, I think it's important to note that a ton of cellular biology and even computational biology is "not reproducible." This could be anything from bad documentation of how something was run (computational scientists are often terrible at lab notebook culture), to having a model system that lived for a while and no longer exists in the form that initial discoveries were made with. Or it could be that there was just that one batch of reagents that reliably reproduced a phenomenon, and all future orders of the reagents no longer get the same phenomenon, and whatever the difference was is lost to time.
But I would claim that especially in biology, though this is less than ideal for writing up near little explanations of reality, it is still extremely useful for understanding what's going on. Scientific papers aren't meant to be ever-lasting truth, like a textbook. They are communications amongst specialists about "look here something cool happened that may be useful to you too." It is only through lots of work that a phenomenon can be established as widespread in biology, and sharing information before doing 10 years of work helps accelerate everything.
This is why I roll my eyes at complaints like that one about "foundational cancer research papers not being reproducible." It was written by scientists in industry who wanted to take a new paper and develop an entire drug program
around something particularly novel and surprising. Sure, that would be ideal if it worked, but the scientific literature is a lot more than a catalog of ideas ready for commercialization. Scientists in practice understand the limitations of taking a journal paper as gospel. They always try to get something working in their own hands before basing a lot of research off another paper.
- SubiculumCode 5y agoAs a fellow scientist, thank you for your dissemination of how science is actually conducted, and what any single paper or series of papers mean. Progress almost always occurs due to the assessment of converging methods and analytic approaches, almost like individual papers are weak classifiers in a big beautiful bag.
- epistasis 5y agoExactly, the phenomena are often way too complex for even a series of papers to come up with the proper abstractions to plan the right experiments. The history of chromatin marks is really illustrative of this. We had lots of early experiments to establish the antibodies to even measure the chromatin marks, and then then two decades of gathering enough data to lead to useful abstractions. And now it's all converging with the 3D organizational data from Hi-C experiments, and DNA methylation from methyl-Seq, and over the past decades the measurement technology (driven by DNA sequencing) has advanced so much that somebody in 2001 trying to anticipate this trajectory would be amazed. What was a single paper back then? Reproducible? Maybe, but that's much less important than pointing to the correct direction in this n-dimensional search space of what to examine next. I've never looked at the historical literature from, say, 100 years ago, but I suspect that it's quite the same as today in all regards. There's a ton of great ideas that never get the attention they deserve, a bunch of ideas that get way too much attention due to fashion or due to influencers that chose the wrong path. But who could we trust to chart a better path? Just like startups, we must accept a high failure rate when exploring the unknown.