3 ms·
it's just not. Evolution learns more sloly than reinforcement learning, which itself learns much more slowly than supervised deep learning. Evolution doesn't h
by make3 9y ago
it's just not. Evolution learns more sloly than reinforcement learning, which itself learns much more slowly than supervised deep learning.
Evolution doesn't have gradiants, and needs a huge amount of samples to learn anything.
- cshenton 9y agoActually, evolutionary strategies make use of either empirical or naturalised gradients on the search space.
- make3 9y agoI guess sexual reproduction is kind of like sharing gradients. Is that what you mean?
- cshenton 9y agoNot quite, genetic algorithms represent the search space usually as bit sequences, so you can just mix subsequences from two parents, that's reproduction. In contrast, evolution strategies have a search distribution, and compute a gradient update to that distribution from an entire generation. So it's really more 'search gradients' than evolution. The only thing 'evolutionary' about it is that the minibatches are called generations.