> If so, who is going to fund it? Considering the difficulty outlined in the article is in optimising the more 'cutting-edge' approaches (i.e. those without ma

> If so, who is going to fund it? Considering the difficulty outlined in the article is in optimising the more 'cutting-edge' approaches (i.e. those without manually optimised kernels), there are numerous AI research centres (in industry and academia) that would be quite keen to reduce the compute cost of exploring new approaches / architectures. The vast majority of companies applying ML are unlikely to step outside of the "mainstream" in terms of model architecture (at least currently), and thus the conclusions aren't particularly relevant to them.