Another way how to characterize the "context of [deep] machine learning" is that it is the regime of high temperature (stochasticity) as a result of small batc

Another way how to characterize the "context of [deep] machine learning" is that it is the regime of high temperature (stochasticity) as a result of small batches and/or large learning rates, and/or the regime of high momentum (Adam et al.). The evolutionary dynamics in the genetic space is (intuitively) at much lower temperature (shorter jumps) and with no momentum (because of the evolutionary pressure).