2 ms·
That is a great point. I'm not sure if I fully understand your question, but I'll comment on both "testing," meaning doing the analysis, and "reviewing," meanin
by physicsdude 28d ago
That is a great point. I'm not sure if I fully understand your question, but I'll comment on both "testing," meaning doing the analysis, and "reviewing," meaning peer review.
The point of "blinding," as I mentioned it before, is to guard against biasing the result due to choices made by analysts while figuring out how to compute their final answer. Part of that is just psychological --- if an analyst _knows_ that the data is obscured, for lack of a better term, in a way such that they can't believe a signal that they see (for example --- that's just one way to blind), then they won't feel any emotion or excitement about things they encounter while constructing the analysis, because they know what they're looking at isn't real, and that helps them to maintain objectivity. It's also common to have multiple independent analysis teams for something like this --- they know that they'll have embarrassed themselves if they don't all get the same result both before and after unblinding, which provides pressure to maintain objectivity.
As far as review goes --- there are physicists who believe in dark matter, and there are physicists who don't believe in dark matter. But all particle physicists and nuclear physicists use the same core technical and statistical methods. For a result like this, there will be a few "core analysts" who do the analysis, typically graduate students and postdocs. Their advisors review their work, through the lens of making sure that they are doing so sanely. The collaboration will also establish an internal review committee to comb through the documentation and software which produced the result, not necessarily trying to disprove what they found, but really looking at it critically. Once it gets to a journal, they'll get reviewers who may be biased for or against the result, and who may or may not work directly on dark matter detection, but who can all assess the methodology by which the result was obtained. That's probably the best we can do with humans involved.