4 ms·
If LSTM is up there, maybe Transformer authors should also be listed somewhere? I mean LSTM is fine and all, IIRC, it only becomes popular after one of Hinton's
by tanilama 8y ago
If LSTM is up there, maybe Transformer authors should also be listed somewhere? I mean LSTM is fine and all, IIRC, it only becomes popular after one of Hinton's students put it to work? And that is like in 2013. Similar tales to the CNN as well.
Hinton/Lecun pioneered early BP research, which is significant and fundamental. Bengio has attention mechanism/GAN, and in early days greedy layer wise pretraining for RBM (which isn't something end up today, but pertaining is a thing back in pre 2010 era).
Not saying LSTM isn't significant, but his achievements aren't quite there with those 3, looking closer.