12 ms·
How a word sparked a four-year saga of climate fact-checking
- wolfgke 10y agoI see a large problem in the fact that (as it seems) the original data and the computer code is not published, too. This is in my opinion a contradiction to the scientific principle that any result or conclusion has to be able to verified independently as much as possible. Though not publishing data and computer programs (and ideally a virtual machine for independent execution of the program code, too) is unluckily accepted practise in science. If it were otherwise any critic of the result could reapply the computer program to the non-detrended data and see that the conclusion will not change. On the other hand, if the computer program and data is not published he has to trust the conclusions that the researchers came to. So the only way for an independent person to check the result is to find indirect evidence that the conclusion could be wrong. And finding out that a different data set than (wrongly) claimed was used is exactly such indirect evidence (and in my opinion nearly as far as one is able to if one doesn't have access to the used data and computer programs).
- DasBlob 10y agoWhile I certainly share your sentiment that both, data and analysis software, should be available, I do see a conflict of interest here that cannot be easily resolved. On the one hand, we do assert (wrongly, IMO) that competition is a necessary element to drive scientific innovation and consequently require scientific actors to adhere to economic principles, i.e. publish more and better-received papers. On the other hand, allowing researchers to keep their competitive advantage, and having exclusive access to research data certainly is, contradicts the principle of reproducability and unneccessarily restricts further research that could be done based on that data. I don't see a way to easily resolve that in the current scientific framework. One (less than optimal) approach, that is frequently taken in astronomy, is to allow exclusive access to telescope data to the members of the consortium or the principal investigators for a certain amount of time, after which it is released to public. As for the software, it's easier. if the analysis method is sufficiently well documented (and it should be in any publication), people with access to the original data can easily attempt to reproduce the results and either way they'll get a publication out of it. So there is no incentive to keep the analysis software but there is a huge incentive to keep the original data.
- wolfgke 10y agoThe solution should rather be that society (and publishers) does not consider papers (or more generally: texts) as research that don't also publish everything possible for independent verification (in this case the source code and raw data). If this is not the case, the text is just a plain marketing statement (in contrast to research) comparable to the marketing statements that are made everyday by lots of companies.
- dalke 10y agoThe lack of source code does not make everything produced by software "a marketing statement." There's more than one way to verify a conclusion. For example, if I say that RSA-130 = 39685999459597454290161126162883786067576449112810064832555157243 × 45534498646735972188403686897274408864356301263205069600999044599 then you can easily verify it by multiplication - you don't need access to the factorization software I used to determine that result. If I say that the energy difference between two chemical structure according to the Merck Molecular Force Field (MMFF) is X, then you can use any software which implements the MMFF to verify my statement using the raw data - you don't need the source code that I used. In fact, it would be better to use an independent implementation to verify my result than it would be to re-run the same code. And there are many programs which implement the MMFF. If you are used to RDKit, then it will likely be faster to use RDKit to reproduce and verify my numbers than trying to figure out the strange VM I provided, which is based around some home-brew code of mine implemented in MORTRAN.
- wolfgke 10y ago> For example, if I say that RSA-130 = ... × ... then you can easily verify it by multiplication - you don't need access to the factorization software I used to determine that result. I didn't write about independent computation, but about independent verification. In your case you need access to a software for multiplying numbers for an independent check. OK, this is rather trivial code to write. But if it weren't that trivial the author would have to provide it.
- 10y ago
- jackmott 10y ago>any result or conclusion has to be able to verified independently as much as possible Well, collecting the data yourself and writing the code yourself would be even more independent.
- wolfgke 10y ago> Well, collecting the data yourself and writing the code yourself would be even more independent. I wrote "any conclusion". This does not preclude collecting the data or writing the code yourself (and indeed you should if you doubt, say, the data). But it implies that the code that was used to come to the conclusion must be available.
- jkot 10y ago> Meanwhile, our team received a flurry of hate mail and an onslaught of time-consuming Freedom of Information requests for access to our raw data and years of our emails, in search of ammunition to undermine and discredit our team and results. > The mammoth process involved three extra rounds of peer-review and four new peer-reviewers. From the original submission on 3 November, 2011, to the paper’s re-acceptance on 26 April, 2016, the manuscript was reviewed by seven reviewers and two editors, underwent nine rounds of revisions, and was assessed a total of 21 times – not to mention the countless rounds of internal revisions made by our research team and data contributors. One reviewer even commented that we had done “a commendable, perhaps bordering on an insane, amount of work”. So one side you do this "mammoth" and "insane" task to review paper. On other side you block people from doing independent audit? Climate studies decide how billions (if not trillions) of dollars are spend. People should be allowed to cross examine raw data and program source code.
- lostlogin 10y agoIf its coming with hate mail and or has a generally offensive tone, I don't think it unreasonable to be unhappy. The author doesn't appear to have blocked access. One can cross examine without being a dick.
- deleted 10y ago[deleted]
- jkot 10y agoRead linked article, offensive language was used AFTER they refused to provide raw data. It took lawsuit to get them.
- frankquist 10y agoContext was not provided however - an article that calls researchers bimbos is not one I take on its word. Was the raw data refused? And why was it refused? Perhaps because they were, as the original article states, prepping the study for publication, or because they had put it on hold? Or because they put the paper on hold and wanted to focus on doublechecking it before spending work on making the data available? Perhaps they still had to retrieve the rights to publish the data, or find a way to publish it in a good way? Context is lacking to state that there was a non-benign refusal of data.
- dzdt 10y agoGlobal warming denialists are attempting a denial-of-service attack against global warming science. The goal is to keep the science unsettled so no major policy changes are made while those making the most profits from climate-changing activities continue to do so.
- socialist_coder 10y agoYup; just like tobacco, acid raid, DDT, and the hole in the ozone layer. Very very sad. It shows you how powerful greed is, when people are willing to sacrifice humans lives and even the future of our planet just to maximize profits. This is one of the main failures of our capitalist economy, IMO. The system needs a built in way to assign a value on sustainability and human well being, rather than just profits.
- titzer 10y agoI was about to respond to your comment and argue that some of them generally have good intentions, and that your comment was paranoia about a conspiracy....but then I realized you pretty much nailed it. I used to doubt climate science...15 years ago. Now I don't.
- socialist_coder 10y agoSee https://en.m.wikipedia.org/wiki/Merchants_of_Doubt https://en.m.wikipedia.org/wiki/Merchants_of_Doubt for mor on that, if you are interested. Very good book.
- SeanDav 10y agoNo idea why this is a surprising, even controversial result. We are are on the warming side of a recent (geologically speaking) ice age (actually glacial period) and we expect long term temperatures to be trending ever upwards.
- phaemon 10y agoNo we're not. The complete opposite in fact: the planet would naturally be cooling now were it not for the increased amount of greenhouse gases in the atmosphere.
- SeanDav 10y ago> "Technically speaking, we’re living during an ‘Ice Age’ today – in the sense that we have a world with glaciers. However, the present time is a relatively warm phase within a period of geological time when glaciers and ice sheets have typically been larger and more extensive than now." Taken from: http://www.rgs.org/OurWork/Schools/Teaching+resources/Key+Stage+3+resources/Glaciation+and+geological+timescales/Ice+Ages+and+geological+timescales.htm http://www.rgs.org/OurWork/Schools/Teaching+resources/Key+St... There are other sources, but this is one example that makes it clear we have been in a warming phase the last few thousand years.
- a2l 10y agoAlso from the same site: > "Since the industrial revolution in the 18th century, the concentration of carbon dioxide in the atmosphere (an important greenhouse gas) has risen significantly above the level it would be naturally. It now stands at over 400 parts per million (ppm) in the atmosphere. Evidence from ice cores (see Lesson four) tells us that the normal level for CO2 in the atmosphere during ‘interglacial’ times (such as the Holocene in which we now live) is 270 to 290 ppm, and that at no time over the last 800,000 (the time covered by ice cores) has the CO2 level been as high as it is now. (CO2 is thought to be at its highest level for three to five million years.)" http://www.rgs.org/OurWork/Schools/Teaching+resources/Key+Stage+3+resources/Glaciation+and+geological+timescales/The+Ice+Age+postponed+-+Impacts+of+melting+ice+in+a+warming+world.htm http://www.rgs.org/OurWork/Schools/Teaching+resources/Key+St...
- frankmcsherry 10y agoI'm personally inclined to support the climate change folks, being a scientist and stuff, but it's a bit crap to claim that it was a one word typo when the original text apparently read: > For predictor selection, both proxy climate and instrumental data were linearly detrended over the 1921–1990 period to avoid inflating the correlation coefficient due to the presence of the global warming signal present in the observed temperature record. Only records that were significantly ([pre]p<0.05[/pre]) correlated with the detrended instrumental target over the 1921–1990 period were selected for analysis. That isn't a typo, it is just being wrong. I'm glad they re-did the work to confirm it was still true, but it's hard to argue with folks who didn't think the claim was supported by the data.
- dozzie 10y agoWell, what you expect from people who happen to turn around in their (unverifiable) models 180 degrees (Amazon jungle net produces oxygen! No, it's a net consumer!) and who routinely produce models that use some physical value (heat capacity in greenhosue effect), but fail to account for major substances influencing the value (water concentration in atmosphere)?
- jackmott 10y agoI'm not an expert on the history of opinions on amazon oxygen, but >but fail to account for major substances influencing the value (water concentration in atmosphere)? is absolutely false.
- dozzie 10y agoOK. Now show me any study that accounts that the water in the atmosphere (0.4% on global level, after Wikipedia, not 1% on the sea level) has ten times higher concentration than methane (0.00018%) and CO2 (0.039%) combined, and almost twice as big heat capacity (75 J/(mol * K)) as each of those (36 J/(mol * K) for methane, 37 J/(mol * K) for CO2). To sum up, heat capacity of atmospheric water being twenty times bigger than CO2 and CH4.
- jasonellis 10y ago
- barney54 10y agoFor another view of this issue: https://climateaudit.org/tag/gergis/ https://climateaudit.org/tag/gergis/
- patrickg_zill 10y agoGeneral observation is that neither the mathematical models nor the data is perfect. For example, oceanic thermocline data, from what I understand, is not really collected. We have an imperfect model being fed incomplete data? Why be surprised at debate over it? People laugh today at ether and phlogiston debates, but such acrimonious debate pushed forward science to the point where we had exactly the right answer.
- sxcurry 10y agoThe problem is that we're not really having debate, as this article makes clear. We are having scientists attacked by 2 groups: climate deniers funded by large corporate masters, and random groups of crackpots. Real debate would be good but I think we're well past that point.