5 ms·
This has already been discussed extensively here (see: http://news.ycombinator.com/item?id=4097116 http://news.ycombinator.com/item?id=4097116) For the record,
by InclinedPlane 14y ago
This has already been discussed extensively here (see: http://news.ycombinator.com/item?id=4097116 http://news.ycombinator.com/item?id=4097116)
For the record, my vote is that this is pseudoscience. No theory, model, or testable predictions are presented. It is a non-falsifiable idea that is couched in such generic and vague terms that it could mean just about anything.
- tsotha 14y agoI would even go so far as to call it junk science.
- methehack 14y ago"Did you read the original article or just the news story?", he asked, exasperated. The article that the news story references was just published in Nature, which has been around since 1869, is peered reviewed, well-respected, oft-cited, and has many distinguished moments, including the initial publication of Watson and Crick's work on DNA. "pseudoscience" might be unfair. Nice object lesson in the "social structures for doing something just aren’t there" though.
- temphn 14y agoWhen publishing a paper, "peer review" typically means that two or three scientists ask you for one round of revisions before publishing. It does not mean complete replication of the source code and data analysis. It means a cursory pass, not a complete unit test suite. Nature and Science in particular have been forced to retract many papers recently for failure to replicate. A short list of recent retracted Nature and Science papers: http://retractionwatch.wordpress.com/2010/10/14/highly-cited-harvard-stem-cell-scientist-retracts-nature-paper/ http://retractionwatch.wordpress.com/2010/10/14/highly-cited... http://www.genomesunzipped.org/2012/04/guest-post-accurate-identification-of-rna-editing-sites-from-high-throughput-sequencing-data.php http://www.genomesunzipped.org/2012/04/guest-post-accurate-i... http://www.scientificamerican.com/article.cfm?id=study-fails-to-confirm-existence http://www.scientificamerican.com/article.cfm?id=study-fails... And here is a recent climate paper by Gergis which was retracted after the blogosphere found flaws while attempting to replicate their work: http://climateaudit.org/2012/06/10/more-on-screening-in-gergis-et-al-2012/ http://climateaudit.org/2012/06/10/more-on-screening-in-gerg... All of those papers were beaten up after they were accepted because other scientists couldn't replicate their results. Perhaps we should see whether this too holds up to scrutiny for a few years before remaking the $100T world economy.
- scarmig 14y ago"retracted" is a bit strong: more accurate would be, put on hold temporarily while a statistical flaw is fixed. Even the author of the blog concedes that the overall paper could stand perfectly fine after the flaw is corrected. It's also interesting to note how the "auditors" compare to the scientists: while the scientists graciously send a thank you for pointing out a flaw and get to work on fixing it, the auditors seem almost entirely focused on crowing, getting a scalp and spreading conspiracy theories and innuendo. Interesting.
- temphn 14y agoWell, the "auditors" are called denialists and attacked from many sides -- even though they are the only ones who publish full source code, push for raw data release, and actually try to replicate results. We are making $100T decisions on the basis of $1M papers and closed datasets. Regarding retraction, I think this is pretty unambiguous http://climateaudit.org/2012/06/08/gergis-et-al-put-on-hold/ http://climateaudit.org/2012/06/08/gergis-et-al-put-on-hold/ Dear Stephen, I am contacting you on behalf of all the authors of the Gergis et al (2012) study ‘Evidence of unusual late 20th century warming from an Australasian temperature reconstruction spanning the last millennium’ An issue has been identified in the processing of the data used in the study, which may affect the results. While the paper states that “both proxy climate and instrumental data were linearly detrended over the 1921–1990 period”, we discovered on Tuesday 5 June that the records used in the final analysis were not detrended for proxy selection, making this statement incorrect. Although this is an unfortunate data processing issue, it is likely to have implications for the results reported in the study. The journal has been contacted and the publication of the study has been put on hold. This is a normal part of science. The testing of scientific studies through independent analysis of data and methods strengthens the conclusions. In this study, an issue has been identified and the results are being re-checked. We would be grateful if you would post the notice below on your ClimateAudit web site. We would like to thank you and the participants at the ClimateAudit blog for your scrutiny of our study, which also identified this data processing issue. Thanks, David Karoly Print publication of scientific study put on hold An issue has been identified in the processing of the data used in the study, “Evidence of unusual late 20th century warming from an Australasian temperature reconstruction spanning the last millennium” by Joelle Gergis, Raphael Neukom, Stephen Phipps, Ailie Gallant and David Karoly, accepted for publication in the Journal of Climate. We are currently reviewing the data and results. Now, props to Karoly for being gracious in this takedown. Part of the problem is that a scientific paper is like a monolithic binary where a bugfix means going out and recalling every copy of the software out in the field. So paper authors usually are very resistant to bugfixes, as they are career ending.In this case Karoly severely damaged Gergis' career and may have hurt his own. From a purely self-interested perspective he should have just stonewalled the "denialists" like Michael Mann has. But he was honest as a scientist. Much better to move towards an open source culture where a "paper" is just the documentation for a major version number associated with a data/code repository.
- InclinedPlane 14y agoYes, I read the original, in its entirety. As to peer-review, this was not published as either an "article" or "letter" (see: http://www.nature.com/nature/authors/gta/2a_Manuscript_formatting.pdf http://www.nature.com/nature/authors/gta/2a_Manuscript_forma...) but as a "review", which is more or less just a published essay. As such it falls under a much different peer review guideline. Even so, peer review is no surety of fact, far from it, it's nothing more than a signoff that the authors have seemingly followed the basic forms of reproducible scientific investigations. However, in this case I think that Nature has let down its readers even in publishing this essay as a "review". There is nothing that is not vague and generic in this essay. There is no model here, no theory. And no predictions nor falsifiability. It is not science in any sense and should not be treated as science. At best it is the shadowy outline of a future theory, at worst it is politics, mysticism, and superstition masquerading as science. And yes, reprinted in one of the most prestigious science journals of our times. That doesn't make it better, that makes it worse.
- astrofinch 14y agoAt first I shared your frustration, but I glanced at the paper and it looks to me (as a layman) as though the authors did their homework. It was published in Nature after all. Here's a high level intuitive argument: Imagine that lots of important parameters about the Earth's climate and ecosystems could be modeled using a bunch of differential equations. Right now, due to humans, our current state is deep in historically unexplored territory. To be safe, it makes sense to try to modify all the parameters we can back to where they were in case weird stuff happens in the unexplored territory.
- scarmig 14y agoIt's also important to note that this is a review article: it's an attempt to distill an opinionated consensus in the field, not to fully flesh out the models and provide all the empirical evidence. For that, the reader should check the copious end notes.
- InclinedPlane 14y agoJust because they have plenty of notes doesn't mean that they've come up with something worthwhile. Their "theory" is nothing more substantive than New Age mysticism. They talk about states, state shifts, and forcings but do not fully describe any of them except at the most superficial levels. They put forward no tests (quantitative or qualitative) to determine the boundaries of a state or to test whether a "state shift" has occurred. That is a flaw at the very lowest level of their "theory". On top of that they build many fanciful constructs which have even less basis in the scientific method. I've commented on this before, but it bears repeating. Here is "Figure 2" from the article: http://i.imgur.com/Zi3uB.png http://i.imgur.com/Zi3uB.png. Neither axis is meaningful, they both lack a definition for what is being measured, let alone how, let alone how to sort it, even qualitatively. This is junk. It's no better than a diagram with "mood" on the y-axis and "emotional energy" on the x-axis, it's utterly, utterly meaningless.