3 ms·
You are right, but at the same time it's great that finally it seems that we have an efficient unified model for language and image modelling. Having CNNs and R
by xiphias2 6y ago
You are right, but at the same time it's great that finally it seems that we have an efficient unified model for language and image modelling. Having CNNs and RNNs separately was relatively hard to work with (especially RNNs). It would be bad if we would need different hardware accelerator architectures for the two most important / different fields of AI. Also having a unified architecture will help with mixed tasks.
https://github.com/lucidrains/lambda-networks https://github.com/lucidrains/lambda-networks
https://www.youtube.com/watch?v=3qxJ2WD8p4w https://www.youtube.com/watch?v=3qxJ2WD8p4w
https://openreview.net/pdf?id=xTJEN-ggl1b https://openreview.net/pdf?id=xTJEN-ggl1b