23 ms·

So to put it another way, these 'scientists' purposely made their data unverifiable and thus non-scientific. IMO any adjusted or modified data is unscientific w

So to put it another way, these 'scientists' purposely made their data unverifiable and thus non-scientific. IMO any adjusted or modified data is unscientific without the original data set and how and why the data was modified the way it was. If you adjust data to normalise it due to the differing global climatic effects of El Nino or La Nina then that's perfectly reasonable, if someone can corroborate what you did and if you did it right. However with no original data set, and apparently no mention of how or why the data was modified the way it was leaves it completely unverifiable and might as well be entirely fabricated.

thras 17y ago
No, no. I agree with you that we need to hold them over the fire on this. But "purposely" is going too far. The best explanation, until proven otherwise, is that somebody goofed.
- patio11 17y ago
  I tend to think good faith is a nice assumption to have, but it should be rebuttable. For example, if someone were to say "I'd rather destroy my data than let it fall to a Freedom of Infomation Act request", and then they were served with a Freedom of Information Act request, and then the data were to be suddenly missing...
- randallsquared 17y ago
  Yeah, "goofed" by sending emails that talk about a plan to delete data rather than turn it over. ;)
  - Anechoic 17y ago
    Were there emails that actually talked about deleting data? I've seen the emails that talked about deleting emails, but not raw data.
    - patio11 17y ago
      1107454306.txt Professor Jones: Just sent loads of station data to Scott. Make sure he documents everything better this time ! And don’t leave stuff lying around on ftp sites - you never know who is trawling them. The two MMs [Patrick notes: he is referring to McIntyre and McKitrick] have been after the CRU station data for years. If they ever hear there is a Freedom of Information Act now in the UK, I think I’ll delete the file rather than send to anyone.
      - Anechoic 17y ago
        Hmm. The rest of that email reads: Does your similar act in the US force you to respond to enquiries within 20 days? - our does ! The UK works on precedents, so the first request will test it. We also have a data protection act, which I will hide behind.
      - Tichy 17y ago
        Why did they not want to give away the data?
        protomyth 17y ago
        Well, if a group has your original source data, they can try to reproduce your results and/or challenge your process. I gather that the results are not likely to stand up to scrutiny.
        Tichy 17y ago
        That seems kind of weird - if they don't show the data, they might as well not bother with collecting data at all. They could just make it all up. Why then, would they bother to mail it around, as they did in the quoted email? I suspect there are some other reasons.
        randallsquared 17y ago
        It would be harder for the scientists to justify making it up to themselves. I assume none of them set out to do bad science when they started investigating climate.
- Nelson69 17y ago
  Normally, I'd agree with you. There seems to be more incompetence than malice, in general. With technology as it is and science as it is and has been for hundreds of years, this seems like an extraordinary goof. I could see a goof being losing a block of data, but all of it? Why was destruction of this data even an option or consideration? How expensive and difficult is it to keep it? I suspect there are numerous other organizations that would store it if they were given copies of it. "Purposely" might be a bit extreme but it was more than a simple goof.
  - protomyth 17y ago
    The thought that someone couldn't walk down to the local store and buy an external hard drive(s) to store this data is unlikely. Heck, a general call out to the community to find storage would work (ask google, they would do it and index it). No, I believe malice is really the only explanation. Raw data allows reproducibility and intelligent debate.
    - Joeboy 17y ago
      The data in question dates from the 1980s. You couldn't "walk down to the local store and buy an external hard drive", and if you could a gigabyte of storage would cost you tens of thousands of pounds. Google didn't exist.
      - protomyth 17y ago
        The data dates from the 80's but it sounds like it was a recent decision to delete the data.
        Joeboy 17y ago
        FTA: "Jones was not in charge of the CRU when the data were thrown away in the 1980s". What part of that makes it sound like this data was lost more recently than the 1980s?
Tichy 17y ago
Not that I disagree, but there are conceivable cases were it seems natural to not keep the "base data" around. For example consider a classical thermometer: temperature data is collected by reading the height of quicksilver in a pipe and transforming it into a temperature according to a device specific scale. I don't think many people keep the actual height readings around, most would probably just keep the resulting temperature. Not that I know that the same applies to the data in question here, just saying. I still wait for the full story.
- biotech 17y ago
  there are conceivable cases were it seems natural to not keep the "base data" around. Your example does not demonstrate this point. By taking the temperature readings in degrees C, you, in fact, are taking the "base data". Of course, you also should record the equipment that you are using to take that data. The height of mercury in your thermometer can be determined by the the brand of thermometer (including the Manufacturer and Model #), and the temperature reading given. Most scientific peer-reviewed research articles are very specific about the equipment being used.
  - Tichy 17y ago
    "By taking the temperature readings in degrees C, you, in fact, are taking the "base data"." I don't see how? It is a matter of how you define "the base of the data". My point is that there is a calculation on the measurement, and only the result of the calculation is recorded. Hence the base data is discarded. We don't know what calculations were done on the climate date in question here. But it seems at least possible that the calculation is also trivial (for climate researchers anyway, could be some standard procedure), just as to us converting heights to degrees is trivial. Recording the type of thermometer is another matter - likewise the climate researchers will probably record where their measurements were taken, which implies the equipment used. Edit: of course if the calculations are reversible is another issue. I see now that is the point you made with the thermometer (calculate height from make and degrees). Well, it was just an example, and we don't even know yet if the calculations in question here are not reversible. I suppose if they calculated an average they are not. But I also think there are probably many cases where a measurement is just taking an average (probably even the height of quicksilver is an average in a way...).

thras 17y ago

No, no. I agree with you that we need to hold them over the fire on this. But "purposely" is going too far. The best explanation, until proven otherwise, is that somebody goofed.

patio11 17y ago
I tend to think good faith is a nice assumption to have, but it should be rebuttable. For example, if someone were to say "I'd rather destroy my data than let it fall to a Freedom of Infomation Act request", and then they were served with a Freedom of Information Act request, and then the data were to be suddenly missing...
randallsquared 17y ago
Yeah, "goofed" by sending emails that talk about a plan to delete data rather than turn it over. ;)
- Anechoic 17y ago
  Were there emails that actually talked about deleting data? I've seen the emails that talked about deleting emails, but not raw data.
  - patio11 17y ago
    1107454306.txt Professor Jones: Just sent loads of station data to Scott. Make sure he documents everything better this time ! And don’t leave stuff lying around on ftp sites - you never know who is trawling them. The two MMs [Patrick notes: he is referring to McIntyre and McKitrick] have been after the CRU station data for years. If they ever hear there is a Freedom of Information Act now in the UK, I think I’ll delete the file rather than send to anyone.
    - Anechoic 17y ago
      Hmm. The rest of that email reads: Does your similar act in the US force you to respond to enquiries within 20 days? - our does ! The UK works on precedents, so the first request will test it. We also have a data protection act, which I will hide behind.
    - Tichy 17y ago
      Why did they not want to give away the data?
      - protomyth 17y ago
        Well, if a group has your original source data, they can try to reproduce your results and/or challenge your process. I gather that the results are not likely to stand up to scrutiny.
        Tichy 17y ago
        That seems kind of weird - if they don't show the data, they might as well not bother with collecting data at all. They could just make it all up. Why then, would they bother to mail it around, as they did in the quoted email? I suspect there are some other reasons.
        randallsquared 17y ago
        It would be harder for the scientists to justify making it up to themselves. I assume none of them set out to do bad science when they started investigating climate.
Nelson69 17y ago
Normally, I'd agree with you. There seems to be more incompetence than malice, in general. With technology as it is and science as it is and has been for hundreds of years, this seems like an extraordinary goof. I could see a goof being losing a block of data, but all of it? Why was destruction of this data even an option or consideration? How expensive and difficult is it to keep it? I suspect there are numerous other organizations that would store it if they were given copies of it. "Purposely" might be a bit extreme but it was more than a simple goof.
- protomyth 17y ago
  The thought that someone couldn't walk down to the local store and buy an external hard drive(s) to store this data is unlikely. Heck, a general call out to the community to find storage would work (ask google, they would do it and index it). No, I believe malice is really the only explanation. Raw data allows reproducibility and intelligent debate.
  - Joeboy 17y ago
    The data in question dates from the 1980s. You couldn't "walk down to the local store and buy an external hard drive", and if you could a gigabyte of storage would cost you tens of thousands of pounds. Google didn't exist.
    - protomyth 17y ago
      The data dates from the 80's but it sounds like it was a recent decision to delete the data.
      - Joeboy 17y ago
        FTA: "Jones was not in charge of the CRU when the data were thrown away in the 1980s". What part of that makes it sound like this data was lost more recently than the 1980s?

Tichy 17y ago

Not that I disagree, but there are conceivable cases were it seems natural to not keep the "base data" around. For example consider a classical thermometer: temperature data is collected by reading the height of quicksilver in a pipe and transforming it into a temperature according to a device specific scale. I don't think many people keep the actual height readings around, most would probably just keep the resulting temperature. Not that I know that the same applies to the data in question here, just saying. I still wait for the full story.

biotech 17y ago
there are conceivable cases were it seems natural to not keep the "base data" around. Your example does not demonstrate this point. By taking the temperature readings in degrees C, you, in fact, are taking the "base data". Of course, you also should record the equipment that you are using to take that data. The height of mercury in your thermometer can be determined by the the brand of thermometer (including the Manufacturer and Model #), and the temperature reading given. Most scientific peer-reviewed research articles are very specific about the equipment being used.
- Tichy 17y ago
  "By taking the temperature readings in degrees C, you, in fact, are taking the "base data"." I don't see how? It is a matter of how you define "the base of the data". My point is that there is a calculation on the measurement, and only the result of the calculation is recorded. Hence the base data is discarded. We don't know what calculations were done on the climate date in question here. But it seems at least possible that the calculation is also trivial (for climate researchers anyway, could be some standard procedure), just as to us converting heights to degrees is trivial. Recording the type of thermometer is another matter - likewise the climate researchers will probably record where their measurements were taken, which implies the equipment used. Edit: of course if the calculations are reversible is another issue. I see now that is the point you made with the thermometer (calculate height from make and degrees). Well, it was just an example, and we don't even know yet if the calculations in question here are not reversible. I suppose if they calculated an average they are not. But I also think there are probably many cases where a measurement is just taking an average (probably even the height of quicksilver is an average in a way...).