3 ms·
A number of groups worked on this at the same time and of course because it is machine learning, everyone had to come up with their own name for it. Even though
by orbifold 6y ago
A number of groups worked on this at the same time and of course because it is machine learning, everyone had to come up with their own name for it. Even though most of these are basically elementary linear algebra dressed up by fancy language and lots of computationally expensive experiments.
- xiphias2 6y agoYou are right, but at the same time it's great that finally it seems that we have an efficient unified model for language and image modelling. Having CNNs and RNNs separately was relatively hard to work with (especially RNNs). It would be bad if we would need different hardware accelerator architectures for the two most important / different fields of AI. Also having a unified architecture will help with mixed tasks. https://github.com/lucidrains/lambda-networks https://github.com/lucidrains/lambda-networks https://www.youtube.com/watch?v=3qxJ2WD8p4w https://www.youtube.com/watch?v=3qxJ2WD8p4w https://openreview.net/pdf?id=xTJEN-ggl1b https://openreview.net/pdf?id=xTJEN-ggl1b