I think we're going to see a few more large step improvements in training efficiency. I think that hardware reliability might sneak back into the picture as th

I think we're going to see a few more large step improvements in training efficiency. I think that hardware reliability might sneak back into the picture as the odd bit error may prove to be far more disruptive to these optimized training algorithms.