3 ms·
Forgive me if this completely misses per the disclaimer in my first comment: In the driving example, can the differentiable loss be a derivative of a quality s
by RLmagic 6y ago
Forgive me if this completely misses per the disclaimer in my first comment:
In the driving example, can the differentiable loss be a derivative of a quality scoring algorithm, possibly another NN, that measures episodic quality at various time and distance-based intervals?
For example, the RL systems loss/reward function attributes a quality score to every 1 second or 1/10th of a mile.
My guess is that there are well known problems with this assumption. What are they?
Thanks for the response!
- morei 6y agoThat's kinda just moving the problem: What is this quality scoring algorithm and how do we built it? If we had such a quality score, then the problem becomes differentiable and far easier to manage. But it's hard because we don't have (and don't know how to build) such a metric.