3 ms·
Perhaps that's in the HN comments more than in the research. IME, for as long as I've read HN, commenters have claimed to have found errors in methodology or si
by wolverine876 5y ago
Perhaps that's in the HN comments more than in the research. IME, for as long as I've read HN, commenters have claimed to have found errors in methodology or similar basic problems. I don't know if I've seen any research posted that didn't receive that response.
- zzt123 5y agoI feel like academica kind of incentivizes this. It’s hard to resist without a good base of support, and I feel like having such a base isn’t the average. I notice this pressure felt strongly across the board by my friends who are adjuncts (or tenure-track, but not yet tenured) in the soft sciences. But this is just anecdotal of course.
- wolverine876 5y ago> I feel like academica kind of incentivizes this. It’s hard to resist without a good base of support Incentivizes what? What is hard to resist?
- zzt123 5y agoGetting a certain volume of publications out. It can be problematic for example when you discover a minor data issue which might not materially change the thesis in your opinion, but if one were wholly following academic guidelines, would warrant delays while you attempt to fix the data issue, if possible. I’ve seen this happen a few times in papers that were never fixed, nor the issue brought up as far as I’m aware. Granted, in each case the thesis was still fine but… makes me wonder about the cases I don’t know about. One of the cases skirted really close to the edge of bs.
- gus_massa 5y agoNote that it's increasingly common to discuss preprints, like in this case. A preprint is as reliable as a blog post in WordPress, unless you work in the area and know that the author has a solid track record. Also, most results that reach the front page here are groundbreaking. But groundbreaking results are very rare, so most of them must be fake, because they have an error or because they are an exaggeration. Most good results are too technical and boring. My favorite example is Magnetoresistance. It's a weird quantum effect that is caused because electrons can have spin up or down. It has a huge effect in the applications and almost everyone had a device that used it. Now the applications are fading. But no one knows it. There are probably 1000 times more discussions here about faster than light travel than magnetoresistance.
- wolverine876 5y ago> A preprint is as reliable as a blog post in WordPress, unless you work in the area and know that the author has a solid track record. While preprints lack some work and signals of reliability, such as peer review, revisions by the author, etc., I think they are far beyond blog posts. Imagine a blog post, by an expert in the domain, with the amount of research and precision that goes into a preprint - there's no comparison. Nothing, not even a peer-reviewed article in Nature, is so reliable that we can just put away our critical thinking.
- gus_massa 5y agoThere is a lot of variation, for example https://terrytao.wordpress.com/ https://terrytao.wordpress.com/ and I remember some guy that claimed that got a fantastic method for factorization that broke RSA and posted it in the arxiv, and the first 5 page of the preprint was an explanation of the rule of nines. (If the sum of the digits of a number is divisible by 9 then the number is divisible by 9.)