These discussions remind me of how there's a years long delay before these ideas first reach boards like HN and then popular magazines and the taxi driver. Yes

These discussions remind me of how there's a years long delay before these ideas first reach boards like HN and then popular magazines and the taxi driver. Yes, code releasing is a big talking point and most major groups release code. It doesn't solve the subtler problems,like claiming 1% improvements as a solid contribution, unequal hyperparameter tuning, cherry picking datasets, overclaiming the novelty, salami publishing, lacking ablations, not comparing against better methods etc etc. Releasing code is a step but not a panacea. At least it partially protects against fully made up numbers which is not nothing, but it's just scratching the surface. In many cases the code is not so easy to use and the original authors may not be willing to help you with reproducing it, ignoring emails and GitHub issues. If you can't reproduce it, they can always claim something. In one case I was told they rewrote the codebase in a new framework since they generated the results in the paper and there may be small discrepancies due to that. Apparently that was enough change that they were no longer the best in the benchmark comparison. But nobody cares at this point, the paper was published, they are on to their next project. People also have the attitude that it doesn't matter anymore, the field has moved on already, a retraction doesn't change much just hurts the author and the group. The vast majority of papers isn't used anywhere actually in practice, the field is moving so fast that any method can only remain on top for a couple of months. Also, I don't think AI really is worse at this. It's rather that we are more open about it because we have less to lose and professors don't have an iron grip, due to the existence of industry. In some of academia your whole future depends on whose ass you kiss, it's better in CS. It's a bit like sexism accusations directed at nerds, as if they particularly bad. The molochian cancer is everywhere. The less you see it may just indicate its more effectively hidden.