8 ms·
That gives me even less faith in the quality of findings. Having seen the pathetic state of literature review in the various engineering fields, I cannot expec
by lrenaud 10y ago
That gives me even less faith in the quality of findings.
Having seen the pathetic state of literature review in the various engineering fields, I cannot expect it to be better in meteorological fields. No doubt there is a certain subset of effective and critical reviewers, but I expect dogma, exciting findings, and name recognition still rule the day.
The most the volume of politics in engineering where our work is not overtly political to those outside outfield is astounding. I don't buy that in a field with so many non-expert pressures applied the review process escapes unadulterated.
- conistonwater 10y agoYour own experience in your own field might not be representative of other fields. Surely you have to consider that possibility?
- mcbits 10y agoThe claim was that peer review in climate science is comparable to any other science. Ignoring the semantics of "engineering" vs "science", if your experience with peer review in another field is not positive, then it's fair to say the claim doesn't inspire much confidence.
- euyyn 10y agoWe're talking about a pile of papers that have been accepted at Nature and Science over a span of decades, not a paper about how Agile is the best programming methodology.
- RyanZAG 10y agoWhile that's true, there is another issue here. If global warming went away tomorrow -- as in, it were to be completely proven to not exist -- every single climate change scientist would be out of a job. They'd literally have to start over their entire professional career from scratch with almost zero chance of getting any kind of funding. This includes everyone who peer reviews the papers too. Meanwhile if Agile is proven to be terrible, it would be a huge boon for those writing about programming methodology as they could easily invent a new one and sell that. So there is far more economic reason for almost every scientist involved to argue that global warming is definitely happening, while there is almost no economic reason for a computer scientist to argue it. So I don't think sheer quantity of papers in journals is necessarily a proof that global warming papers are any better than Agile papers in good journals. EDIT: Instantly downvoted on posting! I've struck a nerve. That, to me, proves that people have a lot more to hide than they let on. I've certainly never been downvoted when discussing an Agile paper. I was also thinking about the papers on Agile vs global warming, and the Agile papers generally read as far more balanced and generally go into much deeper detail than any global warming paper. So I think I'd personally trust the Agile papers more because they do at least have significant discussion on the negatives of the approach and generally cite negative studies themselves.
- conistonwater 10y agoWait a second: with that kind of logic, how would you distinguish "economic reasons" from "scientific reasons"? What, to your mind, distinguishes genuine scientific discoveries from "stuff people believe because they want a job"? Every successful scientific discovery ever got/kept someone a job, and sometimes even a Nobel prize. I can't help but notice that your logic works on every single scientific field, without exception, which tells me it's likely to be flawed, or am I wrong? In the end, the only proper way to do this is with arguments based on merit, rather than perceived motivations of other people, because those perceptions are much more likely to be flawed than arguments based on merit.
- RyanZAG 10y agoI don't that's true. For an example that would apply to computer science: "99% of computer scientists agree that computers are the future of mankind". I don't think you even need to do a study here, it's obvious that around 99% of computer scientists would believe that, because it's what their lives are built around. Climate change scientists' lives are built around the existence of climate change, and so obviously they'd have the same beliefs. Where the value of a scientific paper comes in is within the discipline: how do a I best use this computer to accomplish something? How do I best cut down on the effects of carbon on the atmosphere? If I increase oxygen density, what will happen? Regardless of the answer to these questions, the people involved will be able to continue their lives. They're disconnected with economic reasons because no matter the answer to the question, there is more work for them. Economic reasons come in when the results of a study would directly threaten the livelihood of the scientist. In that case, we can't just assume that because all the scientists agree that it's automatically perfect. > In the end, the only proper way to do this is with arguments based on merit, rather than perceived motivations of other people. Correct! My point was more about how the Agile paper is disparaged. I have more reason to believe the results of an accredited and published Agile paper than I do a paper on the very reason an entire field of study exists. My personal belief that climate change is real and a huge problem is irrelevant here: I still find the Agile paper to be more convincing. The only reason I believe in climate change is because I've checked the science myself to the best of my ability, and not because of the peer reviewed papers which I believe would say the same exact thing even if climate change does not exist. Hopefully that makes it clearer.
- makmanalp 10y agoI don't find this type of argument very useful because usually instead of making specific, falsifiable criticisms of the literature, this argument starts with "wow, scientists can be wrong or prone to human biases sometimes" which turns into a general "I have a touchy-feely sense that maybe some stuff is wrong with climate science", which quickly turns into "I guess most of the literature out there is completely wrong and thus we can do away with those conclusions regardless of the volume of evidence" to "I guess everyone and every viewpoint has an equal chance of being right". Of course scientists make mistakes. Of course there is dogma and politics. Of course this has an effect, and of course we should take this seriously - and scientists can and do take it seriously. For example, look up the "reproducibility crisis" - some of the harshest criticism of existing science is yet again made by practicing scientists. But this is different than armchair handwringing.
- cderwin 10y agoYou're right that non-scientific pressures existing isn't sufficient to support the position that scientific research is inaccurate. However, it certainly is solid ground for exercising a bit of skepticism about scientific research -- particularly when it is well documented that the political distribution of scientists does not reflect that of the greater population and the scientific issue at hand has become political. Moreover, there seems to be a knee-jerk reaction among non-experts to discredit this skepticism as being "anti-science" or being the work of climate-change "deniers." For example, see here[0]. The commenter laments that non-experts might suggest a criticism of peer-reviewed work without being an expert themselves on that criticism. He or she even accuses them of arguing in bad faith ("They'll put on all the plumage of reasonable dissent") and suggests that anyone who has not undergone the rigor of peer review is not qualified to have an opinion ("peer review or STFU"). I fear that if there were valid criticism to be heard, it would at best only fall on deaf ears. [0]: https://news.ycombinator.com/item?id=13739382 https://news.ycombinator.com/item?id=13739382
- makmanalp 10y ago> I fear that if there were valid criticism to be heard, it would at best only fall on deaf ears. I'm not closed to this point of view, but it sure seems to be a rare case indeed. If you look at it from the reverse perspective, climate scientists have been explaining /basic/ material and conclusions to deniers for decades now. If you want to criticize, I don't think there should be a peer-review barrier but you sure should at least be familiar with the body of work you're criticizing. Or else, how could you possibly contribute anything of substance? Go read the IPCC reports, or /something/. That's just common sense. A lot of criticism fails to meet that minimum bar, and also has usually been addressed beforehand. I'm not a climate scientist, but right now I'm taking a graduate level class in databases and data systems. We're reading a lot of papers, some from academia and some from industry. But what I'm realizing is how lacking in nuance and content the discussions on even highly technical places like HN can be at times. Like when I see stuff like "NoSQL is bad for joins", it's like "really? on what system? under what conditions?". The ease with which laymen can assert conclusive-sounding statements on a whim is terrifying. The more you learn, the more you get the opposite instinct - to withhold judgement until something seems very clear. This destroys conversation dynamics when scientists are pitted against climate deniers. And a lot of times, I suspect that the arguments made fall in the "not even wrong" category. Then, the people who make the assertions aren't even willing to listen to the counterargument because it's "too technical". As if everything has a pithy one-liner response. In the end, this results in a massive amount of frustration on the part of the scientists, which leads us to the pickle we're in today. Anyway, this discussion reminds me of the whole discussion in the 50s/60s about the health effects of smoking, and how it took forever for doctors and scientists to convince people that this was real. All the tobacco industry had to do was to criticize specific bits and pieces, discredit specific researchers, call things "inconclusive", and suddenly their criticism was as legitimate as a huge body of research. That's the dangerous bit here. Take a look: http://www.who.int/tobacco/media/en/TobaccoExplained.pdf http://www.who.int/tobacco/media/en/TobaccoExplained.pdf