4 ms·
Imitation learning field has produced learning and inference algorithms that produce regret minimizing policies that don’t depend on the length of the sequence
by vjerancrnjak 3y ago
Imitation learning field has produced learning and inference algorithms that produce regret minimizing policies that don’t depend on the length of the sequence of decisions. Naively training will likely lead to “label bias”. NNs manage to delay it significantly due to very good learned representations of data. But without proof that the learning algorithm produces bounded regret or that the inference/learning is not done over joint loss (of sequence of decisions) the error will most likely accumulate .
- polygamous_bat 3y agoYou may enjoy this paper: https://arxiv.org/abs/2307.14619 https://arxiv.org/abs/2307.14619