4 ms·
The problem is that it is too easy to have wrong ideas. If there only metric is how many studies you (or your group) have published, some will try to game it.
by gus_massa 8y ago
The problem is that it is too easy to have wrong ideas. If there only metric is how many studies you (or your group) have published, some will try to game it.
- rtpg 8y agoIn domains like chemistry, you hae this research process of "try every combo of material x process and see what you get". Hopefully detailed null results will avoid too many people going down the same path. But even more hopefully, it will let other researchers read the process and perhaps find another way to actually get to success. "We tried A x B in this way, that way, some other way, none of them worked" is pretty valuable info. Also pretty good when it comes to confirmation of theoretical work
- adtac 8y ago>We tried A x B in this way, that way, some other way, none of them worked How searchable is this data? Like, do I need to be an expert who is up-to-date on most proceedings in the subfield to know this, or is this information easy to pull up with a few searches?
- duxup 8y ago" it is too easy to have wrong ideas." I would be so published all the time...
- oldgradstudent 8y agoNot all negative results are created equal. It is very easy to run a terrible study. Even with a good idea, it is very easy to run a terrible study.
- solomatov 8y agoA possible problem I see is that it's hard to distinguish truly bad idea from a low quality implementation of a good one.
- analog31 8y agoIn my view, a negative finding needs to be as solid as a positive one, i.e., just as hard to publish. Since folks haven't until recently published negative results, we probably haven't developed standards for reviewing those results. If you're a reviewer of an paper that reports a negative result, how do you decide if the work was carried out with sufficient skill to make the result useful? Should negative results be replicated?
- SubiculumCode 8y agoNegative results generally carry weight IFF they are well powered (large samples), and conducted with real expertise and care.