5 ms·
I wonder if there's a trick we're missing related to the dead-tree history of papers that we could address. Namely, paper references always reach back in time.
by hinkley 4y ago
I wonder if there's a trick we're missing related to the dead-tree history of papers that we could address.
Namely, paper references always reach back in time. Papers don't reference papers that were written after they were written. And if that sounds stupid, bear with me a second.
We've talked a lot about the reproducibility problem, and that's part of propagation errors in papers (I didn't prove this value, I just cribbed it from [5]). If we had a habit of peer reviewing papers and then adding the peer review retroactively to the original paper, both for positive and negative results, would we slow this merry-go-round down a little bit and reduce the head-rush? Would that help prevent people from citing papers that have been debunked?
- renewiltord 4y agoSolid point. The paper is a delta-mapper: it provides a p --> ∆p prior to posterior-change. However, it does not tell you anything about p or p'=p+∆p itself. To get true value of p^n, we sum over all ∆p in some way (affected by the path we take through papers addressing). You're modifying the thing so that future ∆p^{i+k} are added to the delta-mapper so that ∆p is appropriately modified accounting for that ∆p^{i+k}. It's like path-compression in a union-find structure. It is interesting as a helpful approach but does suffer from the pingback spam problem, right? And I have a slightly sneaking suspicion that it is not an accidental oversight in science that leads to these problems.
- unlikelymordant 4y agoYou can always look at all the papers that cite the paper of interest. That provides the other direction deltas, and is something i do all the time, especially for older papers, looking for papers that might be relevant to me.
- renewiltord 4y agoAh, he was suggesting a "Reverse Bibliography" list on every paper, but we do, in fact, already have that: it's what you're talking about. The "cited in" section all the science search engines offer.
- hinkley 4y agoNot a full reverse list, just for the ones that tried to reproduce the results. The websites can handle the rest.
- renewiltord 4y agoI see. Everything that is "same experimental design" with the same starting hypothesis. I like it.
- q-big 4y ago> Namely, paper references always reach back in time. Papers don't reference papers that were written after they were written. Actually, the opposite happens quite regularly: the author X got a pre-print of a paper by author Y. From Y, he knows that the paper will be published in the future in an upcoming volume of a scientific magazine. So, X already writes this future reference into his paper.