AI is having some reproducibility issues, especially reinforcement learning: https://www.wired.com/story/artificial-intelligence-confronts-reproducibility-cris

AI is having some reproducibility issues, especially reinforcement learning: https://www.wired.com/story/artificial-intelligence-confronts-reproducibility-crisis/ https://www.wired.com/story/artificial-intelligence-confront... In other areas of machine learning, things have gotten a lot better. A decade ago people rarely released their code or trained models. I did this for an early feature learning paper in 2010, which led to it getting a lot of citations. What I'm more worried about is the lack of science in machine learning papers. The code reproduces the result, but the reasons for the efficacy given in the paper are spurious. I like this recent paper that pokes this issue in metric learning: https://arxiv.org/abs/2003.08505 https://arxiv.org/abs/2003.08505