4 ms·
Your response to #1 is nonsensical. Please reconsider your response. Also, could we please stop working in flawed analogies? You've tried to take my statement
by KirinDave 17y ago
Your response to #1 is nonsensical. Please reconsider your response.
Also, could we please stop working in flawed analogies? You've tried to take my statement and substitute in things you consider similar to make a point. But the problem is, they're not similar at all except that there are people called "Scientists" involved. Different fields demand different levels of transparency, archival, and data fidelity.
And the decision to throw away noisy or corrupted data is not unusual even in the medical profession. Go ask St. Jude CRMD for their raw electrocardiogram data for every pacemaker and implantable defibrillator design run. Even the FDA doesn't demand it, and I know for a fact they delete the majority of the raw analogue data. It is not important.
We can reconstruct the data from previously published data and code, if you want it so badly. The operations done in the code are not particularly difficult to reverse to equivalent data.
Even then, would that constitute evidence to you? What's to stop a conspiracy driven group of scientists from simply fabricating realistic-looking raw data? This is just a talking point, and everyone who's not out here with an axe to grind knows it.
- yummyfajitas 17y agoYou've tried to take my statement and substitute in things you consider similar to make a point... Different fields demand different levels of transparency... Could you explain why you feel climate science deserves low levels of transparency, and why conspiracies to delete/withhold data here are acceptable? Regarding medical trials, they do not delete the data they process. A concrete example: consider an fMRI study. The MRI spits out analogue k-space data. The MRI converts this to x-space data (pictures) which are then processed by whoever is running the study. It's legit to dump the k-space data (it's not part of his input), but he can't dump the x-space data. In contrast, I work directly on the k-space data, so I keep it. The rule of thumb is "keep your direct inputs". This is why I say the data was important - it enabled Mann/Jones/etc to publish important results. When (part of) it was made available to Steve McIntyre, it also allowed him to correct mistakes in the results of Mann. Even then, would that constitute evidence to you? What's to stop a conspiracy driven group of scientists from simply fabricating realistic-looking raw data? Unfortunately, there is very little which stops fraudulent scientists. Peer review is not really set up to do this. The best check is openness (release of code and data) and independent attempts to replicate published results. Unfortunately, the folks at CRU conspired to prevent this from occurring. Econometrics journals seem to be taking good steps in the right direction: http://www.econometricsociety.org/submissions.asp#Replication http://www.econometricsociety.org/submissions.asp#Replicatio...
- KirinDave 17y agoThey didn't conspire to prevent it from occurring. Some data was lost, and some bad data was destroyed. In fact, the data that was destroyed does not seem to be part of the data that was lost. And Climate Science didn't need as much transparency years ago before the AGW controversy. Subsequent events rendered old data to be of more value, but we take for granted in late 2009 how inexpensive disks are. They were not nearly so cheap even last year, let alone years ago. However, the volume of data produced by climate science instruments is enormous. It's very unsurprising that some was lost. But I and others keep pointing out: We know how to reconstruct that data from earlier published data (back before any of these emails were written, before any conspiracy you allege existed) and published code. Why is this unacceptable? It seems to me the reason is because you don't like that it's science butting it's rude head into the libertarian economic religion, pointing out resources are finite and liberating whole geologic ages worth of carbon back into the atmosphere can have consequences. Perhaps I am assuming too much, but that is the opinion I keep butting heads with on news.ycomb, which is libertarian-free-market-only-conservative-type rich to an unusual degree, at least for someone who lives in the Capital Of Liberalism.
- yummyfajitas 17y agoHmm, let me make sure I've got this straight. Some CRU folks conspired to hide data from skeptics. Other data was lost, but not deleted. We know this because the people conspiring to hide the data told us so. As for how to reconstruct the data, please explain how. Nearly all statistical data analysis methods in common use are highly lossy [1], which makes reversing them to get back the original data impossible. It's ridiculously unlikely that the entire CRU used only reversible analysis methods. Regarding your "but you are a libertarian, so hah!", I'll mostly ignore it, except to point out that while I am a libertarian on most things, I tend to support regulations which internalize externalities. If I believed the scientific case for AGW, I'd support a carbon tax. [1] E.g., moving averages hide the noise, or finding the mean/sdev discardes everything besides the mean/sdev.
- KirinDave 17y agoSome CRU scientists "conspired" to not release raw segments of data without processing. They didn't want to give it to "skeptics" because these "skeptics" were anomaly hunting the data to try and make an unscientific argument sound scientific. Other raw data of questionable value was not kept. While certainly not the best practices, it's understandable. As for reversing, we can produce a reasonable approximation of the original data because the "shady operation" was linear interpolation and the adding of a small corrective constant. (Cue dramatic musical hit). Of course we cannot recover the exact values, but we can reproduce likely approximations of the data. This is not deep stat here, it's interpolation and corrections. Go look at the code if you don't believe me. The article you're commenting on goes into P.S. I am not addressing the substance of your argument with the claim, "You are libertarian." I am addressing all your points as directly as I can. I'm offering the reason to other readers of this thread as to why I think you're persisting in this argument. This event would be a greater problem if there weren't multiple lines of evidence reinforcing the conclusion.