4 ms·
AI gets backpropagation whereas evolution is more like particle swarm optimization (pick a bunch of random values, then pick more random values near the ones th
by zaptrem 2y ago
AI gets backpropagation whereas evolution is more like particle swarm optimization (pick a bunch of random values, then pick more random values near the ones that do best). Backpropagation is way better/faster since in expectation the gradient points toward a better set of weights, but it relies on a differentiable loss function.