3 ms·
As funny as this may sound, there's some deep value in this: We deeply need more incentives in the academic world to report non-findings like that. We have a st
by vog 9y ago
As funny as this may sound, there's some deep value in this: We deeply need more incentives in the academic world to report non-findings like that. We have a strong publication bias towards positive results, which has already become a huge problem. Moreover, we should have a much stronger focus on repeatability of experiments.
- deleted 9y ago[deleted]
- jimbokun 9y agoAnd maybe this is exactly the trick, make it low key and have a sense of humor about it. Sounds like a site dedicate to "My Ass" results would be extremely popular with grad students and real world researchers. Being able to know "it's not just me" and maybe even avoid some of the stumbling blocks others have run into, or to not just blindly use some approach that happened to work for one experiment, but seems to fail for many others.
- vog 9y ago> And maybe this is exactly the trick, make it low key and have a sense of humor about it. I agree in general, but I'd also love to see those published as actual beautiful papers, not just ugly formatted websites. (Okay, the website in case isn't that bad. At least it's clearly structured and readable.) These would be mostly short papers, for sure. But there could be a separate section in the journals for them - just like the "outtakes" section at the end of a movie.
- nurettin 9y agoThis particular non-finding is mainly about a possible error in tensorflow contrib package, which the author self-admittedly wasn't arsed enough to research into. Probably because of time concerns?
- vog 9y agoMaybe. But if this encourages other people to write a follow-up paper that fixes the issue, it would still serve an important purpose.