3 ms·
I'm a physicist and I've experienced this on the small scale of my own humble work developing measurement equipment. When you observe a surprising effect, you t
by analog31 7y ago
I'm a physicist and I've experienced this on the small scale of my own humble work developing measurement equipment. When you observe a surprising effect, you try to make it go away. First, you check to see if it's reproducible under a variety of conditions. Then you search for sources of bias and error that you might have overlooked. You remove things that you think should be extraneous to the purported effect.
At some point, you're satisfied enough, and you publish. Then the rest of the community goes to work trying to do the same thing, with more care, possibly more money, and more minds working on it.
- wmeredith 7y agoThank you. This an excellent succinct explanation of how unknowns get chipped away over time.
- SiVal 7y agoDecades ago, when doing physics and programming together, I discovered the parallel between my experiment revealing an anomaly unexplainable by the current scientific theories and my code revealing a bug in the current version of the compiler. The most likely eventual outcome was not fame and glory but more likely, "Oh! Oops. Never mind...."
- dwaltrip 7y agoWe should never underestimate the likelihood of a surprising observation being explained by a silly mistake or some mundane chance event. Like you, I've had this experience countless times when debugging a piece of code, usually my own :)
- roywiggins 7y agoIt's never a compiler bug, but when it implies new physics, it is more probably a compiler bug
- deleted 7y ago[deleted]
- quotemstr 7y agoThe famous superliminal neutrino case is a great example of this process at work.
- sampo 7y agoAlso the Pioneer anomaly. From 1998 to 2012 it hinted to new physics (alternate gravity laws) when the Pioneer 10 and 11 probes flied outside the solar system. Then in 2012 it was solved by accounting for the multiple scattering of heat radiation, as the probes are not convex bodies. https://en.wikipedia.org/wiki/Pioneer_anomaly https://en.wikipedia.org/wiki/Pioneer_anomaly
- at_a_remove 7y agoThe Pioneer thing, I should collect on some bets. I was on the side of "not a new force, it's some kind of radiation pressure that we're overlooking by treating this like a sphere." Not long after I mentioned that, I attended a lecture by a guy who spent a lot of time working over Casimir effects on strange topologies yielding equally unlikely results. He said something to the effect of "never underestimate the numerous small anomalies created by minuscule forces on complicated surfaces." I've been watching people look for a fifth force (and sixth) force in different flavors for decades. Maybe there's more out there but we have to work very hard to eliminate all of the numerous potential sources of error. If I had to lay a guess on it, it might take centuries of work find an additional force were it present.
- sterlind 7y agoI really think they should have known better, and done more diligence before announcing the anomaly. Superluminal anything implies clock skew issues, and iirc they didn't methodically eliminate those before going public. I don't think the director would have needed to resign if they hadn't taken the bait so eagerly.
- garmaine 7y agoExcept that this is the replication.
- analog31 7y agoWell, to paraphrase what Bellarmine wrote to Galileo, if it turns out to be true, then we've got some cogitatin' to do. One route is to try and beef up the results, for instance by looking for similar results under different conditions. Then, if someone finds a pattern that ties these results together, there's the chance that they could write a theory. The big win is if theory and experiment can play off of one another as they both gain greater precision and breadth.
- garmaine 7y agoTo be clear, TFA is about the second example of similar results under different conditions. Now they’d be looking for a third.
- mirimir 7y agoTrue. But all too often, people stop checking when their results agree with prior work. But then, eventually, someone is confident enough to publish results that aren't consistent with prior work. Jeng (2005) A selected history of expectation bias in physics <https://arxiv.org/pdf/physics/0508199.pdf> https://arxiv.org/pdf/physics/0508199.pdf> Also see Feynman's comment about the electron charge: https://en.wikipedia.org/wiki/Oil_drop_experiment#Millikan.27s_experiment_as_an_example_of_psychological_effects_in_scientific_methodology https://en.wikipedia.org/wiki/Oil_drop_experiment#Millikan.2...