2 ms·
I'm not in the field but I think it's because historically neural nets were looked down and deemed unpromising because they lacked understanding, compared to Sy
by tarsinge 5mo ago
I'm not in the field but I think it's because historically neural nets were looked down and deemed unpromising because they lacked understanding, compared to Symbolic AI or SVM for example. Since the Deep Learning revolution, which is engineering driven, the trend has inverted, research to understand and theory are seen as the things that hindered progress with neural nets in the past.
- jmalicki 5mo agoPart of the issue with neural nets is that historically they were next to impossible to train. ADAM, BatchNorm/LayerNorm, initialization schemes, and GPUs for pure speed really helped to change all of that.