3 ms·
That "truth compass" they used was reading the method section, which is far from guessing and very close to the scientific process.
by whatshisface 9y ago
That "truth compass" they used was reading the method section, which is far from guessing and very close to the scientific process.
- Analemma_ 9y agoRight, I'm not chalking it up to mysterious psychic powers. What I mean is, it's frustrating in how it demonstrates that our truth-sensing capabilities, and the "pure" scientific method, are actually working just fine and we don't need to have any existential panic over whether truth is unknowable even in noisy data. But those capabilities aren't being used when it comes time to actually write the paper, which is exactly when you should be applying them.
- LeifCarrotson 9y agoIt shouldn't be, though. It may be easy for a scientist to look at the method sections of two papers that had p<0.05 results and say of the first "that looks like a solid study with a reasonable conclusion and robust controls" and of the other "that's bogus". The problem is that without this expert panel making these calls, both studies got published, were given the same credibility, and got consumed by non-experts. Peer review and the publishing process are supposed to weed out the obviously bad studies, but they're not doing so.
- haihaibye 9y agoScientists are familiar with the literature and are taking into account information from other papers when judging a particular one. Individual papers are not a source of truth, they're bits of cumulative evidence hopefully leading to the truth.