4 ms·
Something I've always wondered about- is there no value in failed results? I'd think people would benefit from knowing what approaches have failed. How is that
by Herring 18y ago
Something I've always wondered about- is there no value in failed results? I'd think people would benefit from knowing what approaches have failed. How is that information communicated?
- lliiffee 18y agoIt basically isn't, which I suspect is a huge collective waste of effort. I have several times had what I thought was a reasonably obvious idea that was "sure to work" which I was baffled that I couldn't find in the literature. Then, after spending a lot of time pursing it, I find it didn't work (for non-obvious reasons). I suspect I am one in a line of many people that have gone through that process.
- Hexstream 18y agoAnd I bet you didn't document your failure... like everyone else before you.
- 11ren 18y agoIt would seem embarrassing to write up in a paper; but excellent filler (and justified) in a thesis. The thesis goes online, google indexes it; now it's available as lit.
- deleted 18y ago[deleted]
- shiro 18y agoI like empirical papers describing experiences of applying ideas in real situations, in which they tend to expose unsuccessful approaches they have tried before finding one that works. It is not only useful but also enjoyable to read. I'd like to see more of those papers, especially from industry. But to write such kind of paper, you usually have to devote to a successful project all the way through, which usually takes a few years or more, and then you can write just one paper. Not very efficient way to produce publications, and you might have to write a paper in your spare time, for your employer wants you to write code instead....
- joeyo 18y agoI occasionally wish there was a Journal of Negative Results. However, there is a real problem in that it is nearly impossible to properly interpret a negative result. Something might not work because you have a sloppy experimental technique or because you have a typo in the implementation of your algorithm.
- waldrews 18y agoThere are real current efforts to create such publications. This is quite relevant in pharmacology and other areas where biostatistics is applied, since there are often fewer incentives to publish the results of, say, a drug trial that fails to find a significant effect. Hence, The Journal of Negative Results in Biomedicine (yes, it is actually called that): http://www.jnrbm.com/ http://www.jnrbm.com/
- d0mine 18y agoIt is called publication bias. http://en.wikipedia.org/wiki/Publication_bias http://en.wikipedia.org/wiki/Publication_bias
- tokenadult 18y ago"Something I've always wondered about- is there no value in failed results?" Peter Norvig has some great comments on the problem of NOT communicating failed results in his article on interpreting research. http://norvig.com/experiment-design.html http://norvig.com/experiment-design.html
- deleted 18y ago[deleted]