3 ms·
This year brought to us huge improvements in handling text (BERT), speech (Google TTS, especially the Allo demo), images (ProGAN, StyleGAN, BigGAN) and activiti
by visarga 8y ago
This year brought to us huge improvements in handling text (BERT), speech (Google TTS, especially the Allo demo), images (ProGAN, StyleGAN, BigGAN) and activities such as games (Alpha Zero), and robotics. Even music composition is improving a lot. I don't feel it is slowing down yet. And when it will eventually slow down, it will be all for the better - we will have time to reopen all those different approaches that have been more or less ignored because of the DL hype.
I think the key fields in AI will become simulator based learning (RL) and graph processing neural nets, because graphs can express any kind of highly dimensional data and are useful for reasoning tasks. They marry the symbolic and connectionist approaches. These two subdomains have had rapid evolution over the last couple of years. They also solve the data problem - in simulation you can produce as much data as you want, and graphs have combinatorial generalisation, thus they work on new configurations without retraining.