3 ms·
This isn't correct. No amount of compute power will let a RNN/LSTM outperform a Transformer. No amount of compute power will let an AlexNet or Inception style
by nl 6y ago
This isn't correct.
No amount of compute power will let a RNN/LSTM outperform a Transformer.
No amount of compute power will let an AlexNet or Inception style network train as well as a ResNet.
- anukriti 6y ago> I think the fact that we're seeing so much progress in deep learning without any theoretical basis I don't understand what you mean by this? Any neural network is first build in theory and then tried out practically by coding and testing. I think practitioner and scientist play equal role.