4 ms·
With SGD, you know how to take steps in the direction of a better solution. You don't have that with genetic programming, there you just know if a solution happ
by lars 11y ago
With SGD, you know how to take steps in the direction of a better solution. You don't have that with genetic programming, there you just know if a solution happened to be better.
- p1esk 11y agoThere's a weight perturbation algorithm, which is somewhat similar to genetic programming. The reason it's not as popular as SGD/backprop is it's computationally intensive, and it's hard to parallelize.
- reader5000 11y agoWith sgd you only know a locally better solution. GP has this as well: take the best current instance and mutate it/recombine it.