6 ms·

It's not that the experiment is not accurate, "accuracy" is simply not the aspect of the measurement being discussed. The sentence "That's precision, not accura

It's not that the experiment is not accurate, "accuracy" is simply not the aspect of the measurement being discussed. The sentence "That's precision, not accuracy." should be read to mean "we are discussing precision, we are not discussing accuracy" rather than "it's precise, but inaccurate".

Wowfunhappy 4y ago
But I feel like in this context, we're discussing both.
- Mezzie 4y ago
  Precision and accuracy are slightly different mathematical concepts, as demonstrated by this image [0]: [0]: https://wp.stolaf.edu/it/files/2017/06/precsionvsaccuracy_crashcourse-579x600.png https://wp.stolaf.edu/it/files/2017/06/precsionvsaccuracy_cr...
  - rektide 4y ago
    To be honest accuracy Vs precision has always kind of makes sense to be but also not. If something is extremely accurate, it will also be extremely precise by necessity, it seems like? The difference between low precision but high & low accuracies is that points are closer to center. If you keep getting closer to center, more accurate, don't you necessarily get more precise too? Precise has always felt like a shitty alternate of accuracy. It's accuracy but with drift, accuracy to not the right place. But if you're accurate, you're both. Am I missing something? And, here specifically, if this is a case of very high precision but lower accuracy, can someone explain what the drift from center is about? Isn't a radius a radius? Where is the drift off center in these measures?
    - alexpetralia 4y ago
      I wrote about precision here if you are interested. You first need precision before you can start even talking about accuracy (otherwise there is no "center"). https://alexpetralia.com/2023/01/31/what-does-it-mean-for-data-to-be-precise-part-4/ https://alexpetralia.com/2023/01/31/what-does-it-mean-for-da...
    - hansvm 4y ago
      Something is accurate in this sense if the "true" value (ignoring any philosophical implications thereof) is contained in the error bounds of the measurement. What you're noting is that a high accuracy measurement will, upon application of statistics, allow you to derive a new measure which is both high-accuracy and high-precision, regardless of the low precision of any inputs. Not all things being described with accuracy and precision are the result of processing large amounts of data though.
    - moron4hire 4y ago
      I don't like the lower left quadrant of that diagram, because it's not clear that it's not centered on the target. It would have been more clear if the cluster was smaller so it could be moved to not be centered on the target. Accurate but imprecise means we can throw more and more shells down range and eventually hit the target. Inaccurate and imprecise means we may never hit the target. Inaccurate but precise also means we may never hit the target, but if we could introduce a second, different measurement that was accurate, we could compensate.
  - deleted 4y ago
    [deleted]
  - spiralx 4y ago
    I saw a Greek food stall in town a couple of years back with the statement "Food delivered with mathematical accuracy" which just bugged the hell out of me lol.
- PezzaDev 4y ago
  No. Precision and Accuracy have very specific definitions in the world of science and engineering. https://en.m.wikipedia.org/wiki/Accuracy_and_precision https://en.m.wikipedia.org/wiki/Accuracy_and_precision
  - jvanderbot 4y ago
    So, when one uses statistics to rule out deviations below 1E-17 radians (or whatever), you're all saying that's not accuracy, it's precision. I'm also surprised, since IIRC precision is a measure of variance from a set of measurements, and accuracy is a measure of deviation of a value from true. The statistical aggregation to get an estimate should (I think?) increase both the accuracy of that estimate (it will converge to the true value) and it's precision (the spread of subsequent estimates with more measurements converges to zero or some noise floor). Here we're measuring something like eccentricity, which has a value and error bars. And the claim is we have eccentricity zero with precision high enough to rule out deviations below 1E-17 radians. So yeah, precision seems to be the better of the two, but accuracy matters. Either way, this is insanely pedantic.
    - zmgsabst 4y ago
      Consider the case where there’s a configuration error — say, a cable not properly seated. You can have results that are highly precise, but due to cable issue, not baselined correctly and therefore systemically inaccurate. Eg, faster than light neutrinos. https://en.m.wikipedia.org/wiki/Faster-than-light_neutrino_anomaly https://en.m.wikipedia.org/wiki/Faster-than-light_neutrino_a... I think people get confused because they forget that systemic bias can impact precise measurements: if your system is wrong, you’ll precisely come to the wrong conclusion.
      - alexpetralia 4y ago
        Yes, exactly: bias + imprecision = inaccuracy.
        deleted 4y ago
- georgyo 4y ago
  I can say Pi = 3 and be accurate but not precise. I can say Pi = 3.0000004 and be precise but not accurate. But that's not where the confusion comes from. It comes from measuring equipment. Example, if I have a scale that is sensitive enough to give several decimals of precision, it is very difficult to calibrate it so it is accurate. Anyone who owns a gram scale knows you basically have to recalibrate it after every measurement. It will gladly give you many decimals of precision that is just wrong.
  - hansvm 4y ago
    And for today's rant, you can also say Pi = 3 and be precise. Significant figures are a common shorthand for in-band signaling of error, but they're not the only tool and are really only useful insofar as they're pretty easy to do mental math with and relatively well known.
  - deleted 4y ago
    [deleted]
  - shagie 4y ago
    On the subject of scales calibration and really small wights: Veritasium - How To Measure The Tiniest Forces In The Universe https://youtu.be/pXoZQsZP2PY https://youtu.be/pXoZQsZP2PY (it gets into measuring piconewtons and femtonetwons)
kgwgk 4y ago
When they say "they could detect a bump on the North Pole the height of a single sugar molecule" is not about the accuracy of the measurement? If my measurement device always measures 42 it may by hyper-precise - but it won't helping me to detect a bump on the North Pole the height of a single sugar molecule nor anything else.
hansvm 4y ago
But the thing being concluded is that it's not very bumpy, and for that conclusion to hold water the data needs to be both accurate and precise within some very small bound. Spitting out precise measures of electron bumpiness isn't very hard without that accuracy. Right this second I used the "gut feeling" measurement device to conclude that the electron is round within 1024 bits of precision, and yet the authors have a publication and I don't. Is their conclusion over-blown?
- AnimalMuppet 4y ago
  I don't think so. They're not measuring the radius to precision 10^-31 cm. They're measuring the differences in radius against zero, and they know the value of zero to infinite precision.
  - hansvm 4y ago
    Sure, but it's precisely that difference which they claim to be measuring. Why does it matter that they don't also know some other value (the radius) to high accuracy? It's kind of like how a balance can measure the difference in force to high accuracy (and precision), but that doesn't mean we know anywhere near that much about the masses on the balance, and...it doesn't have to; you can just state that you know some delta accurately and not have to explain why that means some auxiliary measurement is probably precise.
- moron4hire 4y ago
  Say I devised a test of the smoothness of steel ball bearings. Maybe it'd be something like rolling the bearing around on a soft substrate and then checking the substrate for scratches. That test would be precise (I'd know the maximum bound on the size of imperfections in the bearing) but not accurate (it wouldn't tell me anything about the absolute radius of the bearing or the location of the imperfections). The point is, with the information given, we haven't been told anything about the accuracy of the test. Maybe it is. Maybe it isn't. That's just blank information. We've only been told the precision.

Wowfunhappy 4y ago

But I feel like in this context, we're discussing both.

Mezzie 4y ago
Precision and accuracy are slightly different mathematical concepts, as demonstrated by this image [0]: [0]: https://wp.stolaf.edu/it/files/2017/06/precsionvsaccuracy_crashcourse-579x600.png https://wp.stolaf.edu/it/files/2017/06/precsionvsaccuracy_cr...
- rektide 4y ago
  To be honest accuracy Vs precision has always kind of makes sense to be but also not. If something is extremely accurate, it will also be extremely precise by necessity, it seems like? The difference between low precision but high & low accuracies is that points are closer to center. If you keep getting closer to center, more accurate, don't you necessarily get more precise too? Precise has always felt like a shitty alternate of accuracy. It's accuracy but with drift, accuracy to not the right place. But if you're accurate, you're both. Am I missing something? And, here specifically, if this is a case of very high precision but lower accuracy, can someone explain what the drift from center is about? Isn't a radius a radius? Where is the drift off center in these measures?
  - alexpetralia 4y ago
    I wrote about precision here if you are interested. You first need precision before you can start even talking about accuracy (otherwise there is no "center"). https://alexpetralia.com/2023/01/31/what-does-it-mean-for-data-to-be-precise-part-4/ https://alexpetralia.com/2023/01/31/what-does-it-mean-for-da...
  - hansvm 4y ago
    Something is accurate in this sense if the "true" value (ignoring any philosophical implications thereof) is contained in the error bounds of the measurement. What you're noting is that a high accuracy measurement will, upon application of statistics, allow you to derive a new measure which is both high-accuracy and high-precision, regardless of the low precision of any inputs. Not all things being described with accuracy and precision are the result of processing large amounts of data though.
  - moron4hire 4y ago
    I don't like the lower left quadrant of that diagram, because it's not clear that it's not centered on the target. It would have been more clear if the cluster was smaller so it could be moved to not be centered on the target. Accurate but imprecise means we can throw more and more shells down range and eventually hit the target. Inaccurate and imprecise means we may never hit the target. Inaccurate but precise also means we may never hit the target, but if we could introduce a second, different measurement that was accurate, we could compensate.
- deleted 4y ago
  [deleted]
- spiralx 4y ago
  I saw a Greek food stall in town a couple of years back with the statement "Food delivered with mathematical accuracy" which just bugged the hell out of me lol.
PezzaDev 4y ago
No. Precision and Accuracy have very specific definitions in the world of science and engineering. https://en.m.wikipedia.org/wiki/Accuracy_and_precision https://en.m.wikipedia.org/wiki/Accuracy_and_precision
- jvanderbot 4y ago
  So, when one uses statistics to rule out deviations below 1E-17 radians (or whatever), you're all saying that's not accuracy, it's precision. I'm also surprised, since IIRC precision is a measure of variance from a set of measurements, and accuracy is a measure of deviation of a value from true. The statistical aggregation to get an estimate should (I think?) increase both the accuracy of that estimate (it will converge to the true value) and it's precision (the spread of subsequent estimates with more measurements converges to zero or some noise floor). Here we're measuring something like eccentricity, which has a value and error bars. And the claim is we have eccentricity zero with precision high enough to rule out deviations below 1E-17 radians. So yeah, precision seems to be the better of the two, but accuracy matters. Either way, this is insanely pedantic.
  - zmgsabst 4y ago
    Consider the case where there’s a configuration error — say, a cable not properly seated. You can have results that are highly precise, but due to cable issue, not baselined correctly and therefore systemically inaccurate. Eg, faster than light neutrinos. https://en.m.wikipedia.org/wiki/Faster-than-light_neutrino_anomaly https://en.m.wikipedia.org/wiki/Faster-than-light_neutrino_a... I think people get confused because they forget that systemic bias can impact precise measurements: if your system is wrong, you’ll precisely come to the wrong conclusion.
    - alexpetralia 4y ago
      Yes, exactly: bias + imprecision = inaccuracy.
      - deleted 4y ago
georgyo 4y ago
I can say Pi = 3 and be accurate but not precise. I can say Pi = 3.0000004 and be precise but not accurate. But that's not where the confusion comes from. It comes from measuring equipment. Example, if I have a scale that is sensitive enough to give several decimals of precision, it is very difficult to calibrate it so it is accurate. Anyone who owns a gram scale knows you basically have to recalibrate it after every measurement. It will gladly give you many decimals of precision that is just wrong.
- hansvm 4y ago
  And for today's rant, you can also say Pi = 3 and be precise. Significant figures are a common shorthand for in-band signaling of error, but they're not the only tool and are really only useful insofar as they're pretty easy to do mental math with and relatively well known.
- deleted 4y ago
  [deleted]
- shagie 4y ago
  On the subject of scales calibration and really small wights: Veritasium - How To Measure The Tiniest Forces In The Universe https://youtu.be/pXoZQsZP2PY https://youtu.be/pXoZQsZP2PY (it gets into measuring piconewtons and femtonetwons)

kgwgk 4y ago

When they say "they could detect a bump on the North Pole the height of a single sugar molecule" is not about the accuracy of the measurement? If my measurement device always measures 42 it may by hyper-precise - but it won't helping me to detect a bump on the North Pole the height of a single sugar molecule nor anything else.

hansvm 4y ago

But the thing being concluded is that it's not very bumpy, and for that conclusion to hold water the data needs to be both accurate and precise within some very small bound. Spitting out precise measures of electron bumpiness isn't very hard without that accuracy. Right this second I used the "gut feeling" measurement device to conclude that the electron is round within 1024 bits of precision, and yet the authors have a publication and I don't. Is their conclusion over-blown?

AnimalMuppet 4y ago
I don't think so. They're not measuring the radius to precision 10^-31 cm. They're measuring the differences in radius against zero, and they know the value of zero to infinite precision.
- hansvm 4y ago
  Sure, but it's precisely that difference which they claim to be measuring. Why does it matter that they don't also know some other value (the radius) to high accuracy? It's kind of like how a balance can measure the difference in force to high accuracy (and precision), but that doesn't mean we know anywhere near that much about the masses on the balance, and...it doesn't have to; you can just state that you know some delta accurately and not have to explain why that means some auxiliary measurement is probably precise.
moron4hire 4y ago
Say I devised a test of the smoothness of steel ball bearings. Maybe it'd be something like rolling the bearing around on a soft substrate and then checking the substrate for scratches. That test would be precise (I'd know the maximum bound on the size of imperfections in the bearing) but not accurate (it wouldn't tell me anything about the absolute radius of the bearing or the location of the imperfections). The point is, with the information given, we haven't been told anything about the accuracy of the test. Maybe it is. Maybe it isn't. That's just blank information. We've only been told the precision.