2 ms·
General purpose AI is not waiting for more compute power. Its waiting for algorithms that can do it. I'm not 100% sure deep learning can get all the way there
by ilaksh 7y ago
General purpose AI is not waiting for more compute power. Its waiting for algorithms that can do it.
I'm not 100% sure deep learning can get all the way there. We might need a new approach. But the deep learning leaders are taking it very seriously and making some progress.
For example, Yann LeCun is talking about self-supervised, learning models of the world. MILA (Bengio's group) is talking about "state representation learning, or the ability to capture latent generative factors of an environment". Hinton now has capsule networks. In my opinion these types of approaches are very promising for general purpose AI.
- jononor 7y agoYeah, many ML applications are bottlenecked on availability of labels, not by compute. Especially once outside very well-defined and established task. I think self-supervised has large potential, at least in expanding ML applications towards "more general".