Exactly, GA suffered very badly during the AI winter to be more specific, but it's coming to the scene again. In fact, GAs don't need gradient information at al

Exactly, GA suffered very badly during the AI winter to be more specific, but it's coming to the scene again. In fact, GAs don't need gradient information at all. If you want to do some weird stuffs like evolving deep networks, multi-objective optimizations or large scale black-box optimization, GAs (and friends) are the only way.