This just goes to show how messed up the whole AI field is right now. It shouldn't be about "trying hard". Either they used the right network for their analysis

This just goes to show how messed up the whole AI field is right now. It shouldn't be about "trying hard". Either they used the right network for their analysis, or they didn't. It should be possible to do negative analysis of AI capabilities. But since there is almost no theory behind this stuff right now (just test sets and architectures targeting particular test sets), anyone can always claim that any negative analysis just didn't target the "right" architecture.