3 ms·

> the advent of CNNs forced some design rethinking, and then the advent of RNNs (and then transformers) did it yet again. Certainly, RNNs are much older than T

by kleiba 2y ago

> the advent of CNNs forced some design rethinking, and then the advent of RNNs (and then transformers) did it yet again. Certainly, RNNs are much older than TPUs?!

woodson 2y ago
So are CNNs, but I guess their popularity heavily increased at that time, to the point where it made sense to optimize the hardware for them.
hyhjtgh 2y ago
RNN was of course well known at the at time, but they werent putting out state of the art numbers at that time.