6 ms·
A lot of the breakthroughs have been in image classification, object detection and image segmentation using deep convolutional models way way outperforming prio
by alexcnwy 7y ago
A lot of the breakthroughs have been in image classification, object detection and image segmentation using deep convolutional models way way outperforming prior approaches and beating human level benchmarks (on constrained problems e.g. classify this image into one of 1000 categories)...
But there have also been significant breakthroughs in:
* image/video generation using generative adversarial networks
* game playing & robotics in constrained environments (AlphaGo, AlphaStar, etc) using reinforcement learning
* natural language processing using semantic word vectors and attentional recurrent models
* voice-to-text using recurrent models
Convolutional and recurrent neural networks were invented in the early 1990s and we’ve only recently got them properly working as tools. I think we’re going to see (and need) more algorithmic breakthroughs to push through the current limitations but I’d be very reluctant to bet against that happening, even if it takes a long time...
- not_a_moth 7y agoSome of your bullets describe methods not useful functions, e.g. > natural language processing using semantic word vectors and attentional recurrent models Where has that made a big impact? Marginally better auto translation between English and French, or random text passage generation that's at best uncanny valley? Probably still falls under OP's heading of "a tool that might help in limited, specific scenarios".
- alexcnwy 7y agoThe impacts in improved translation aren’t marginal - they improve people’s lives in real ways. Advances in deep learning for NLP have also significantly improved search (Google and others) which has a nontrivial impact on people’s lives. Multi-modal models that translate images into words have a significant impact for blind people. Deep learning is significantly improving medical diagnosis, crop yield, assistive robotics, and many other specific scenarios. Specific scenarios matter and again, it’s still very early days...