3 ms·
I increasingly feel that deep learning needs to incorporate more ideas from evolution. Not just for parameter optimization but architecture discovery itself. I
by paraschopra 8y ago
I increasingly feel that deep learning needs to incorporate more ideas from evolution. Not just for parameter optimization but architecture discovery itself.
Imagine pitting neural networks in an adversarial environment (just like the real world). Under competitive pressure for limited food (computation resources), evolved neural network could start approaching optimal architectures that do the job but have no superfluous, pre-conceived notions of the (modeled) world. In fact, such evolved architectures could encode relevant notions of the world directly which we can learn about by reverse engineering evolved architecture.
This is closely related to the ideas from predictive processing which closely ties survival to prediction (as to predict your future states is to avoid getting dissipated). So I'm anticipating evolution or survival notions to come up in a big way in ML/Deep Learning in future.
- ovi256 8y ago>approaching optimal architectures that do the job but have no superfluous, pre-conceived notions of the (modeled) world Usually, modelling efficiency is related to the amount of priors. The more (correct) priors, the faster a model learns, and from less data. A prior-poor model just spends data learning those correct priors in the first place. There are countless examples I could give to support intuition of this. There isn't, AFAIK, any theoretical work yet. That the priors are correctly aligned with reality is vital. A model with fixed bad priors cannot unlearn them. If the priors are bad but not fixed, you're just spending time and data to correct those priors.
- paraschopra 8y agoYes, and evolution builds priors into organisms.
- DEADBEEFC0FFEE 8y agoDo you mean, like a GA of NNs, pretty sure that has been done many times.
- rytill 8y agoThis is currently very prolific and successful. You don’t have to imagine anything. Latest popular paper on the specific application of evolution you’re talking about: https://arxiv.org/abs/1808.00193 https://arxiv.org/abs/1808.00193
- Izkata 8y ago> Imagine pitting neural networks in an adversarial environment (just like the real world). Under competitive pressure for limited food (computation resources), evolved neural network could start approaching optimal architectures that do the job but have no superfluous, pre-conceived notions of the (modeled) world. Sounds almost like these robots [0], which learned to lie to each other. They didn't use a neural net, though. [0] http://discovermagazine.com/2008/jan/robots-evolve-and-learn-how-to-lie http://discovermagazine.com/2008/jan/robots-evolve-and-learn...