3 ms·
They really came to the forefront with alex.net - GPUs plus lots of labeled examples made them suddenly very practical.
by Fede_V 11y ago
They really came to the forefront with alex.net - GPUs plus lots of labeled examples made them suddenly very practical.
- simonhughes22 11y agoYes and No. Layer to layer training of deep belief nets were doing very well before alex.net came along, although alex.net was seminal for images. People often miss the big 'advances' in RNN's, although those go back to the 90's and earlier. A lot of this (but not all) is also due to more data, better and faster hardware (including GPU's). Although there have been some important algorithmic enhancements too.