4 ms·
Since I don't have the datasets that underlie this code I can't actually execute it That's the point. No-one can. Let me tell you, if a bank "lost" their tradi
by gaius 17y ago
Since I don't have the datasets that underlie this code I can't actually execute it
That's the point. No-one can. Let me tell you, if a bank "lost" their trading data, or a drug company "lost" their clinical trials data, or an engineering firm "lost" the data they verified their avionics with, there would be hell to pay. Why's everyone giving these bozos, whose model materially affects all our lives, a free ride?
- KirinDave 17y agoBecause there is a lot of corroborating data and physical evidence to back up what they're saying? No one is giving these folks a free ride. Heck, the article you just quoted from steps into the code in detail to see what this "very artificial" adjustment does. We take for granted now that no data should ever be thrown away, but even as early as 5 years ago that simply wasn't economically feasible. Heck, even scientific institutions with data of extreme historical significance like NASA has lost key data (first moonwalk raw video) because of cost-cutting measures and bureaucratic SNAFUs. By the way, the way in which their model is materially affecting our lives is overall positive even if you don't believe in anthropogenic global warming. We have lots of reasons as a post-industrial nation to want to remove our dependence on foreign oil (and other foreign fuel sources which we have failed to stockpile, such as uranium). What's more, we can make a killing in the market if we can design low-overhead renewable energy systems for the rest of the world. So consider that you may disagree with the map but agree on the direction we're going.
- gaius 17y agoSo consider that you may disagree with the map but agree on the direction we're going. The Green camp themselves ought to be up in arms over this - they ought to have no fear of their data being scrutinized. That's what science is. Before admitting to "losing" the data, the CRU tried all sorts of excuses to evade their obligations under Freedom of Information - and now we only have their word that the data was lost when they said it was. Science or superstition, those are the only choices here.
- KirinDave 17y ago"Before admitting to "losing" the data, the CRU tried all sorts of excuses to evade their obligations under Freedom of Information"... I really think you're attributing malice when bureaucracy would suffice. What little malice there is in the equation is a bunch of scientists frustrated with the sensationalist tactics of some colleagues who fight the data with public opinion and fast talking instead of a real scientific line of counter-evidence. Asking to go through the raw data at this point is going to be nothing but the climate-science equivalent of looking for EVPs in a haunted house; you're anomaly hunting. Even with the original data gone enough of the post-processed data and the code that generated it remains to paint a clear picture of what is going on. If you doubt this specific line of evidence please feel free to look at other corroborating lines of evidence. I think you have a specific lens you're viewing this situation through and when you're hunting for witches, you can always find evidence. Every action becomes part of some sinister plot. Be very careful of conspiracy thinking, because it's extremely hard to get out of it once you're there. As I've said before, this event damages the public's confidence in the CRU. They've shown how grumpy scientists can be in private (who knew?). But there is still no evidence–in any of these emails–of misleading fabrication of data. That is, unless you're convinced AGW is fake already, in which case you're going to say, "AHA! See I knew it!" While I concede the case for the "antrhopogenic" is certainly not as ironclad as we'd like it to be, it's also not unsupported or implausible. At this point denying global warming itself is roughly akin to denying evolution: it's asinine. Multiple lines of evidence converge on one conclusion, and if a few odds and ends don't line up for reasons we don't understand, that's not significant enough to do anything more that continued research. P.S. This is not to say I know AGW is real. All I know is that we have a greater body of evidence that it is real than counter-evidence against this. _That_ is the science here.
- yummyfajitas 17y agoI really think you're attributing malice when bureaucracy would suffice...Be very careful of conspiracy thinking, While in general I'm suspicious of "conspiracy thinking", it's quite reasonable in this case: the conspiracy (to delete and wrongly withhold data) is now a matter of public record: Michael Mann: "...don’t pass it along where it may get into the hands of the wrong people." Phil Jones: "If FOIA does ever get used by anyone, there is also IPR to consider as well. Data is covered by all the agreements we sign with people, so I will be hiding behind them. " More Phil Jones: "I think I'll delete the file rather than send to anyone." Tom Wigley: "Mike, Can you delete any emails you may have had with Keith re AR4? Keith will do likewise." Tell me; would you give someone working in financial services the same level of leeway that you seem to want to give to the CRU folks? "I think I'll delete the file rather than send it to the SEC". - "What little malice there is in the equation is a bunch of bankers frustrated with silly SEC rules designed to keep politicians happy."
- jgrahamc 17y agoDid you read my last paragraph? But all the talk of not releasing data and hiding from FOIA requests does make me uneasy. Science is better when other scientists can reproduce what you are doing, I'm not happy about that either.
- gaius 17y agoIf a bank repeatedly refused to hand over its data to the regulator after some fraud occurred, then suddenly changed their tune and said the data was lost, someone's going to jail. If a drug company does the same after some side-effects are discovered, ditto. If an engineering firm after an airliner goes down, or a bridge collapses, ditto. Now we are being asked to redirect resources in the entire global economy based on... What, exactly? The word of people who have been caught with a smoking gun of disregarding the scientific process to silence their critics by any means necessary? Everyone, the greens especially, ought to be furious.
- jgrahamc 17y agoActually, I am very upset about the fact that all the data was not being routinely released so that others could follow along or falsify. But I'm not letting that cloud my own analysis of the source code that has been released.
- sethg 17y agoIf this one study were the only evidence of global warming, it wouldn't justify redirecting the global economy's resources, even if we had all the raw data.
- flipbrad 17y agofine, but losing it undermines the overall case and any present justification there is. how much is a matter of opinion, but it's bound to be non-negligible given the continuous obstructionism to releasing it in the first place.
- Nwallins 17y ago> Science is better when other scientists can reproduce what you are doing s/is better when/requires that/ Right?
- DannoHung 17y agoTrading data comes in many flavors. If you're talking about the executions the bank actually performed, no, that's not going to get tossed away. On the other hand, if you're talking about the terabytes upon terabyte of quotes (even level 1 quotes on equities mind you), yeah, those get tossed. And key decisions get made based on that data. That stuff gets kept around for a while, but it gets deleted eventually.
- anonjon 17y agoDid you read past the first paragraph? The linear interpolation applied is so that the tree-ring data better matches the actual temperatures that were collected. The actual temperature measurements still indicate exactly what they indicated before. The question is whether tree ring data is a good way to measure temperature since 1400, or, what happened since about 1960 to cause the model to diverge so drastically. (Or perhaps it is neither and there is some biological factor..) These questions were both brought up as being 'of concern' in the published paper, not hidden away or covered up. Linear interpolation is a purely deterministic process... as such, it could be easily removed from any data that had it applied (which is apparently only the tree-ring data in this case). To compare this to massive bank fraud is nothing short of malicious. Certainly, be upset about the missing data. But be more upset about the people who are blindly ignoring all of the data that still points to global warming and actually believe that something like this would disprove it.
- dagw 17y agoIt is quite common to throw away raw data, especially a few years ago when data storage was very expensive. For example a friend of mine worked on a project which generated about 20-40 gigs of data a day (and this was back in the day when that was a lot of data), most of which was noise. They'd only keep the raw data around long enough to filter out the noise and then only store the filtered data. Any other approach would have bankrupted the project in storage costs.