4 ms·
It's refuting the premise that supervised RL becomes less supervised because you put the feedback in a handcrafted function and use a neural network. Deep RL in
by freeone3000 5y ago
It's refuting the premise that supervised RL becomes less supervised because you put the feedback in a handcrafted function and use a neural network. Deep RL in its current state should be grouped with Supervised RL, in other words (which is why I personally think that imitation learning is a great way forward, in contrast with the author). The issue is the amount of interactive tweaking and lack of a natural reward function that prevents DeepRL from being unsupervised.
- rich_sasha 5y agoAlphaZero is not supervised, in the sense that it learned from known correct actions (earlier versions of AlphGo did learn from online games). So although it needed human supervision, sure, it didn’t need us to provide correct answers. The authors point does somewhat stand that you don’t have the problem of reward engineering in board games so they are a dead end from that point of view - they skirt around the core problem instead of tackling it.
- freeone3000 5y agoAlphaZero only works on video games. If you remove its ability to judge progress by game score, which is a reward function (though not the one used, due to delayed reward issues), then it's not capable of finding its feedback. It only works in constructed environments where the environment provides the reward function implicitly. Maybe we can video-game-ify laundry folding sufficiently? I'm doubtful.