6 ms·

I’d say it’s just a different kind of evidence. It’s obviously not on the same level as direct observation, but it can provide useful information we can use to

by simonh 4y ago

I’d say it’s just a different kind of evidence. It’s obviously not on the same level as direct observation, but it can provide useful information we can use to refine our theories and home in on specific behaviours we can look for in direct observations and experiments. Saying that this information is not evidence, of any kind, seems to me to be terminological points scoring. It’s evidence for what to look for next experimentally. I’m also annoyed by people saying things like simulation “isn’t science”. We’ll obviously it’s not all of science, we can’t run a simulation and say all right, job done, we’ve finished the science. Nobody is claiming that, it’s a complete straw man. Simulations can absolutely be part of the scientific process. I just don’t see the point in these “well actually” rebuttals of claims never actually made by these researchers, or the author of the article. It’s the same old story every time any science news gets posted here.

adrianN 4y ago
It's evidence if it can be used to falsify theories, imo. That is true of some computational science, i.e. if you use a computer to make predictions from a theory to compare the predictions with observations.
- morelandjs 4y ago
  Exactly, if you can falsify theories subject to the assumptions of the simulation, that’s still evidence.
  - pdonis 4y ago
    > if you can falsify theories subject to the assumptions of the simulation, that’s still evidence. No, the falsification itself is not evidence; it's a falsification. Evidence is what you compare the predictions of the simulation to, and then you call the theory falsified if the two don't match.
    - kadonoishi 4y ago
      I spent some years doing computer simulations of cancer screening. The confusion between the output of the simulation, which is not evidence, and real evidence, led me into a nightmare of the Hall of Mirrors, where everything I attempted to learn about cancer screening turned out to be merely a reflection of my own assumptions. Everywhere I turned it was another funhouse mirror, where the computer warped my own ideas because the code I wrote was not a perfect flat reflection of what I meant, because my code introduced distortions, which took immense rigor to avoid. The confusion between real evidence, and the output of my computer simulation which was not evidence but I _confused_ it with evidence, led me down a dark path lost in a labyrinth of funhouse mirrors of my own construction. Listen to pdonis, people.
- simonh 4y ago
  There is already a word for what you are describing, and that's proof. Evidence is a far broader term. It can be weak, strong, misleading or just indicative. If I have a problem with the title it's the word "shows", this evidence indicates a behaviour water may have, it doesn't show that it has it.
- pdonis 4y ago
  > It's evidence if it can be used to falsify theories No, this is too broad, because falsifying theories takes two elements: a prediction, and the evidence that the prediction gets compared to. Only the second is evidence; the first is not. And simulations only give you the first.
weego 4y ago
It's pre-evidence. Computer simulations of real-world theoretical phenomena are propositions of potential outcomes that need to be verified through real-world testing to determine whether our modelling correlates with, or is skewing away from, reality.
- pdonis 4y ago
  > It's pre-evidence. No, it's pre-dictions. That's what the rest of your post says. Yes, simulations are one way of finding out what your theoretical model predicts. But evidence is the information from the real world that you compare the predictions with. There is no such thing as "pre-evidence".
pdonis 4y ago
> I’d say it’s just a different kind of evidence. No, it isn't. "Evidence" means something the real world tells you when you run some kind of experiment or make some kind of observation. Simulations are not the real world. > it can provide useful information we can use to refine our theories "Refine" in the sense of "improve the machinery our theories use to make predictions", sure. But predictions are not evidence. Evidence is the information from the real world that you compare the predictions to to see if they are correct.
- canjobear 4y ago
  "Evidence" is anything that should cause you to update your beliefs. The simulations show that a certain possible phenomenon is consistent with known physics when this was not known before, and therefore they raise the likelihood that the phenomenon exists.
  - pdonis 4y ago
    > "Evidence" is anything that should cause you to update your beliefs. No, this is too broad. We are talking about testing scientific theories, not just updating a random person's beliefs. "Evidence" is what you compare theoretical predictions with to test theories. > The simulations show that a certain possible phenomenon is consistent with known physics when this was not known before More or less, yes. > and therefore they raise the likelihood that the phenomenon exists. No, this is a non sequitur. Knowing that a phenomenon is consistent with the laws of physics tells you nothing about whether that phenomenon actually exists. The set of phenomena that actually exist is too tiny compared to the set of phenomena that are consistent with the laws of physics for knowing something is a member of the latter to give any useful information about the former.
    - canjobear 4y ago
      Your argument ultimately comes down to an argument from authority about the use of the word "evidence". Arguments about word definitions are uninteresting. What is substantively at stake is if a simulation like the one in the paper can provide information about a scientific phenomenon. Because a pure simulation can cause a change in beliefs, it does provide information.
tgv 4y ago
My problem with calling this evidence is that the simulation itself is taken as the theory being tested, without saying so. Nothing wrong with that, but it's an extremely specific theory. So specific, we can already call it wrong.

by simonh 4y ago

adrianN 4y ago

It's evidence if it can be used to falsify theories, imo. That is true of some computational science, i.e. if you use a computer to make predictions from a theory to compare the predictions with observations.

morelandjs 4y ago
Exactly, if you can falsify theories subject to the assumptions of the simulation, that’s still evidence.
- pdonis 4y ago
  > if you can falsify theories subject to the assumptions of the simulation, that’s still evidence. No, the falsification itself is not evidence; it's a falsification. Evidence is what you compare the predictions of the simulation to, and then you call the theory falsified if the two don't match.
  - kadonoishi 4y ago
    I spent some years doing computer simulations of cancer screening. The confusion between the output of the simulation, which is not evidence, and real evidence, led me into a nightmare of the Hall of Mirrors, where everything I attempted to learn about cancer screening turned out to be merely a reflection of my own assumptions. Everywhere I turned it was another funhouse mirror, where the computer warped my own ideas because the code I wrote was not a perfect flat reflection of what I meant, because my code introduced distortions, which took immense rigor to avoid. The confusion between real evidence, and the output of my computer simulation which was not evidence but I _confused_ it with evidence, led me down a dark path lost in a labyrinth of funhouse mirrors of my own construction. Listen to pdonis, people.
simonh 4y ago
There is already a word for what you are describing, and that's proof. Evidence is a far broader term. It can be weak, strong, misleading or just indicative. If I have a problem with the title it's the word "shows", this evidence indicates a behaviour water may have, it doesn't show that it has it.
pdonis 4y ago
> It's evidence if it can be used to falsify theories No, this is too broad, because falsifying theories takes two elements: a prediction, and the evidence that the prediction gets compared to. Only the second is evidence; the first is not. And simulations only give you the first.

weego 4y ago

It's pre-evidence. Computer simulations of real-world theoretical phenomena are propositions of potential outcomes that need to be verified through real-world testing to determine whether our modelling correlates with, or is skewing away from, reality.

pdonis 4y ago
> It's pre-evidence. No, it's pre-dictions. That's what the rest of your post says. Yes, simulations are one way of finding out what your theoretical model predicts. But evidence is the information from the real world that you compare the predictions with. There is no such thing as "pre-evidence".

pdonis 4y ago

> I’d say it’s just a different kind of evidence. No, it isn't. "Evidence" means something the real world tells you when you run some kind of experiment or make some kind of observation. Simulations are not the real world. > it can provide useful information we can use to refine our theories "Refine" in the sense of "improve the machinery our theories use to make predictions", sure. But predictions are not evidence. Evidence is the information from the real world that you compare the predictions to to see if they are correct.

canjobear 4y ago
"Evidence" is anything that should cause you to update your beliefs. The simulations show that a certain possible phenomenon is consistent with known physics when this was not known before, and therefore they raise the likelihood that the phenomenon exists.
- pdonis 4y ago
  > "Evidence" is anything that should cause you to update your beliefs. No, this is too broad. We are talking about testing scientific theories, not just updating a random person's beliefs. "Evidence" is what you compare theoretical predictions with to test theories. > The simulations show that a certain possible phenomenon is consistent with known physics when this was not known before More or less, yes. > and therefore they raise the likelihood that the phenomenon exists. No, this is a non sequitur. Knowing that a phenomenon is consistent with the laws of physics tells you nothing about whether that phenomenon actually exists. The set of phenomena that actually exist is too tiny compared to the set of phenomena that are consistent with the laws of physics for knowing something is a member of the latter to give any useful information about the former.
  - canjobear 4y ago
    Your argument ultimately comes down to an argument from authority about the use of the word "evidence". Arguments about word definitions are uninteresting. What is substantively at stake is if a simulation like the one in the paper can provide information about a scientific phenomenon. Because a pure simulation can cause a change in beliefs, it does provide information.

tgv 4y ago

My problem with calling this evidence is that the simulation itself is taken as the theory being tested, without saying so. Nothing wrong with that, but it's an extremely specific theory. So specific, we can already call it wrong.