4 ms·
This shouldn't surprise anyone... People need to realize that research publications are not textbooks. They are communications to other researchers about the w
by epistasis 13y ago
This shouldn't surprise anyone...
People need to realize that research publications are not textbooks. They are communications to other researchers about the way that the evidence is pointing, that helps them design new experiments, that justifies expensive and spendy clinical trials, which eventually find conclusive evidence.
The idea that one can open a science journal and find interpretable truth revealed is a pernicious one. Trust that the data is true, but do not trust the models or the conclusions. Everything is in flux, and it's science because we likely don't know what the real world is like yet.
History will go back and pick out the key experiments and construct a path of discovery, but in real time almost nobody knows what the most important experiments truly are.
This makes for difficult journalism, but one should remain true to the physical world rather than the narratives that are easy to squeeze into 500 word news blurbs.
- 001sky 13y agoThis is all true, but the atricle says something quite different than what you are commenting on. The "original findings" which are being reversed were based on 4,000 pieces of peer-reviewed research. After reviewing more than 4,000 studies, the [1997] authors were persuaded that green vegetables helped ward off lung and stomach cancer. It's easy to dismiss a single instance as an arbitrary data point. When you can dismiss a large portfolio of such points--you have another problem. That problem is a core-weakness in methodology/approach/and institutional incentives. That seems to be the larger issue highlighted here.
- frozenport 13y agoYou need to weight them by quality, from experience in my field of E&M the papers with 2k citations are correct and the ones with 4 citations aren't. Also 4k papers is too much to go through by hand, so something else was done.
- epistasis 13y agoWell, the sentence immediately preceding that one gets it right: >The situation seemed very different in 1997, when the World Cancer Research Fund and the American Institute for Cancer Research published a report, thick as a phone book, concluding that diets loaded with fruits and vegetables might reduce the overall incidence of cancer by more than 20 percent. With "might" being the most important word there. These 4,000 studies were all retrospective analyses, and retrospective analyses only find conclusions of the "might" sort, which is well understood by the scientists, but not so well communicated by journalists. Still, a 20% "might" is a an absolutely enormous amount of potential upside in cancer prevention, even a "maybe" of this magnitude justifies great excitement. Which is why they embarked on the prospective study, which is the real story here. It is absolutely ridiculous to conclude that there are methodology or misaligned institutional incentives based on this case, it's exactly how things should work. It's just another example of scientists being blamed by bad reporting that they have no control over. That said, there are many other cases where methodology is wrong or institutional incentives are wrong.
- tachyonbeam 13y agoIt's not just that. There's a huge problem with selective bias here. People think that "healthy foods" automatically means good health, and bad health is automatically a result of processed foods, "bad health habits", etc. Bad health is your own damn fault for profoundly insulting mother nature by feeding your body Kraft Diner a few too many times. News at 11: cancer is a natural occurrence. You could exclusively eat prime quality fish, raw organic fruits and veggies and still get a heart attack at 52 and cancer at 58. In other news, I seriously question the idea that paleolithic humans had incredible food wisdom and perfect health. They probably ate whatever the hell they could find at a given time of the year in their immediate environment, and that was probably hugely lacking in nutritional value when it's the winter, all the plants are dead and most animals hibernating. I agree that making an effort to eat well is a good idea, but it doesn't make you immune to diseases, and diseases are not necessarily a result of bad habits. There is also a huge amount of conflicting information as to what is healthy food.
- yaketysax 13y ago"News at 11: cancer is a natural occurrence." So what? Something being "natural" has no bearing on whether it is favorable or preventable. "You could exclusively eat prime quality fish, raw organic fruits and veggies and still get a heart attack at 52 and cancer at 58." Of course it's possible. But if you had any amount of sense, you wouldn't be making conclusions from a single case. "In other news, I seriously question the idea that paleolithic humans had incredible food wisdom and perfect health." Who's making that claim? The claim most paleo advocates seem to be making is that you should eat food that the body is adapted to eating.
- csallen 13y ago>> "The claim most paleo advocates seem to be making is that you should eat food that the body is adapted to eating." In full, their claims fall closer to the following: P1. You should eat healthy foods. P2. Foods that the body is "adapted" to eating are healthy. P3. If paleolithic humans ate something, it means our bodies are "adapted" to it. C. We should eat what paleolithic humans ate. The problems with the above line of reasoning are numerous. While most everyone would prefer to eat healthy when possible, the word "adapted" is ambiguous, and the argument that it's healthier to eat foods we're "adapted" to lacks evidence and is overly ambitious. It's hard enough to examine healthiness on a food-by-food (or even an ingredient-by-ingredient) basis, so labeling broad categories of food as healthy or unhealthy is bound to be even harder.