2 ms·
You do realize that main DL ideas have been developed in the 90s, or even earlier? CNNs, RNNs, LSTMs, reinforcement learning, gradient descent, backpropagation
by p1esk 10y ago
You do realize that main DL ideas have been developed in the 90s, or even earlier?
CNNs, RNNs, LSTMs, reinforcement learning, gradient descent, backpropagation - all that was used in the 90s, but given the limited computing power they had, people simply couldn't run large enough models on large enough data to get results.
- eva1984 10y agoWithout development of technique like Dropout Batch normalization, residual connection, better optimizer like Adam, even with enough data and computational power, DL won't be nearly as powerful as it is today.