8 ms·
Why do they fade away? Because the experiments have been misinterpreted?
by k__ 7y ago
Why do they fade away? Because the experiments have been misinterpreted?
- DuskStar 7y agoBecause they're statistical artifacts, basically. P=0.05 means you're got a 1/20 chance of it happening on any given random test set where the bill hypothesis is true, after all. Physics uses far higher confidence levels, but also runs (effectively) massive numbers of tests. That's part of the danger of picking theories based on the data - each degree of freedom in interpretation multiplies your chances of having spurious results crop up.
- kmm 7y agoGiven the high statistical confidence they have, 7.2 sigma or 1 in 2 trillion, it's more likely to be some sort of systemic issue with the experimental setup.
- air7 7y agoThis is well known and corrected for in properly conducted experiments. https://en.m.wikipedia.org/wiki/Multiple_comparisons_problem https://en.m.wikipedia.org/wiki/Multiple_comparisons_problem
- gus_massa 7y agoI almost agree. This is the more probable explanation of the other ~39 anomalies that are at 2 or 3 sigma. As a rule of thumb, don't get too attached to a 2 or 3 sisma because there is a high chance that it is only a statistical fluke and the apparent result will disappear with more data. But this cases has too many sigmas, 7!! And the group has a history of dubious discoveries, like the 5 sigma result in 2015 that was never reproduced. So I'm more inclined for a bad measurement method until an independent group can replicate it.
- peteradio 7y ago> like the 5 sigma result in 2015 Isn't that just an earlier version of the same experiment? Doesn't seem too surprising that a broad distribution has a mean shift with a different experimental setup. I'd count this as a repeat of the same experiment. That of course doesn't rule out some flaw in their experimental setup that happens in roughly the same way in each repeat.
- gus_massa 7y agoThe mass of the result of 2015 is close to the current claim, so I have to correct may comment and say that it has not disappeared (yet). But they have a 13.45+-.30 MeV result in 2012 with a significance of 3 sigmas [1] and a 12.0+-2.5 MeV result in 2008 (I can't find the significance, it looks like a 2 or 3 sigma) [2]. If it possible to get a false result by chance like 1/20 or 1/100 of the times, but they already got 2 of them. So I'm very skeptical of the new third claim. (Also the story about the protophobic particle is strange. There have been more strange things, but this is strange anyway. And it's also not clear why the protophobicity hides the particle in all the previous electron-positron collision experiments in many other laboratories.) [1] https://www.lnf.infn.it/sis/frascatiseries/Volume56/Krasznahorkay.pdf https://www.lnf.infn.it/sis/frascatiseries/Volume56/Krasznah... [2] http://www.actaphys.uj.edu.pl/fulltext?series=Reg&vol=39&page=483 http://www.actaphys.uj.edu.pl/fulltext?series=Reg&vol=39&pag...
- peteradio 7y agoJust to play advocate more, if you look at the broad excess in the angular plot in all those papers it shouldn't be surprising that this results in a broad and changing best estimates for mass. So without crunching the numbers, again its possible all these are measuring the same thing with a fluctuating best guess for mass. I think we shouldn't dismiss the latest result due to the previous results. I think we should wonder what could be the systematic issue that could cause this effect without it being new physics. I think the excess in all the experiments will likely have the same root, be it new physics or something else that is not yet understood. So don't count those previous papers against them, those are all measuring the same thing and the convention of physics to match to some theory is causing the precise conclusion to jump around. If you look at the actual raw data the effect is not changing too much.
- birdyrooster 7y agoYes. They were never really there in the first place.
- analog31 7y agoI'm a physicist and I've experienced this on the small scale of my own humble work developing measurement equipment. When you observe a surprising effect, you try to make it go away. First, you check to see if it's reproducible under a variety of conditions. Then you search for sources of bias and error that you might have overlooked. You remove things that you think should be extraneous to the purported effect. At some point, you're satisfied enough, and you publish. Then the rest of the community goes to work trying to do the same thing, with more care, possibly more money, and more minds working on it.
- wmeredith 7y agoThank you. This an excellent succinct explanation of how unknowns get chipped away over time.
- SiVal 7y agoDecades ago, when doing physics and programming together, I discovered the parallel between my experiment revealing an anomaly unexplainable by the current scientific theories and my code revealing a bug in the current version of the compiler. The most likely eventual outcome was not fame and glory but more likely, "Oh! Oops. Never mind...."
- dwaltrip 7y agoWe should never underestimate the likelihood of a surprising observation being explained by a silly mistake or some mundane chance event. Like you, I've had this experience countless times when debugging a piece of code, usually my own :)
- roywiggins 7y agoIt's never a compiler bug, but when it implies new physics, it is more probably a compiler bug
- deleted 7y ago[deleted]
- 7y ago
- knzhou 7y agoLots of reasons. Statistical fluctuation. Equipment malfunction. Misunderstanding of setup. Underestimation of systematic errors. Improper data analysis. Sometimes, new effects that were previously unknown but don't involve new physics. I once asked a senior physicist what to think about a 4 sigma anomaly that looked like it couldn't just be a systematic effect. He instantly replied "then it's probably two systematic effects pointing in the same direction".