2 ms·

Indeed and other sciences seems even harder to reproduce/verify (e.g. how can mathematicians efficiently verify results if chatgpt can produce thousands of wron

• ben_w 4y ago
  Mathematicians have it easier than most, there are already ways to automate testing in their domain. Kinda needed to be, given the rise of computer-generated proofs starting with the 4-colour theorem in 1976.
  • lairv 4y ago
    > there are already ways to automate testing in their domain. Do you mean proof assistant like Lean ? From my limited knowledge of fundamental math research, I thought most math publications these days only provide a paper with statements and proofs, but not with a standardized format
    • ben_w 4y ago
      I can't give many specifics, my knowledge is YouTube mathematicians like 3blue1brown and Matt Parker taking about things like this.
      • mkl 4y ago
        Only a tiny fraction of existing maths can be done with proof assistants currently, and as a result very very few papers use them. In most current research automated testing would be impossible or orders of magnitude more work; in many areas mathematicians are working with things centuries ahead of where proof assistants are up to, and working at a much higher level of abstraction. Also, many maths papers have important content that is not proofs (and many applied maths papers contain no proofs at all).