3 ms·
Uhh, not all but maybe most in production. You can use any optimization technique you want on training the weights including things like evolutionary algorithms
by Der_Einzige 7y ago
Uhh, not all but maybe most in production. You can use any optimization technique you want on training the weights including things like evolutionary algorithms or simulated annealing which are entirely different from what's listed here. Evolutionary style methods may be SOTA for continuous control reinforcement learning problems... Consider how backprop or hill climbing or LBFG-S performs on something basic like cart pole
- lostmsu 7y agoEvolutionary algorithms are SOTA for continuous control? Never saw a paper claiming that. Which one of them can even compare to soft actor-critic? I believe gradient descent is the king everywhere interesting right now (e.g. CV, NLP, RL).
- Der_Einzige 7y agohttps://openai.com/blog/evolution-strategies/ https://openai.com/blog/evolution-strategies/
- lostmsu 7y agoI have seen this paper. The blog post does not report, that they were able to train a better agent, than A3C. Only that ES allowed them to use more compute power to train in parallel.