Yeah, I just came here to see if there was any discussion about this. I end up implementing stuff out of research papers pretty much exclusively. If I could tra

Yeah, I just came here to see if there was any discussion about this. I end up implementing stuff out of research papers pretty much exclusively. If I could train more efficiently, I would happily. But if I have to build something from scratch using an unconventional paradigm with no large body of research behind it, the value to me is negative, because before I even start I would have to convince my customers they can rely on it, that it matches state of the art, etc. Then I'd have to work with a much smaller set of tools built around it, including pretrained models with ultimately millions of dollars of R&D tied up in them. It's good to see new research, but this is not at all immediately helpful for applied work. Show me ResNet implemented this way, with a comparison of speedup and benchmarks on imagenet, and my opinion will change entirely.