AI seems to me as quite experimental. Designing better benchmarks (that is less cheatable) will help. Publishing code will go against IP policies, that should b

AI seems to me as quite experimental. Designing better benchmarks (that is less cheatable) will help. Publishing code will go against IP policies, that should be handled at the political level : do you research for profit or for knowledge ? But yeah, code adds transparency and a whole lot of cheats... The funny thing is that any well organized coder will automate report production, so it's not like it is hard to do...