3 ms·

gradient descent is faster and more efficient. Why? Regarding neuro-evolution and hyperparameter, here the question becomes why would the stochastic natu

• joefourier 6y ago
  In their basic form, genetic algorithms essentially approximate gradient descent by randomly sampling the search space to find the direction of steepest descent (similar to a finite differences method). If the loss function is differentiable, you are essentially wasting computing resources on calculating paths that are known not to be optimal, hence, why not apply gradient descent directly instead of a slower approximation? Brute force search would be even more inefficient, genetic algorithms at least throw away unpromising directions.