3 ms·

So are CNNs, but I guess their popularity heavily increased at that time, to the point where it made sense to optimize the hardware for them.