> Though maybe I'm missing something 'cos it seems to me you can run gradient descend on non-differentiable functions Isn't that exactly the point though? If y

> Though maybe I'm missing something 'cos it seems to me you can run gradient descend on non-differentiable functions Isn't that exactly the point though? If you don't have an analytical solution for the gradient of the loss (reward) wrt the parameters - yes - you could brute force a numerical solution but as the number of parameters grows that quickly becomes infeasible. Approaches such as RL and GA provide a more intelligent way to search the parameter space.