3 ms·
This is a great tip, thanks! Is this essentially importance sampling? Reminds me of a technique for off-policy RL.
by gradys 6y ago
This is a great tip, thanks! Is this essentially importance sampling? Reminds me of a technique for off-policy RL.
- 317070 6y agoThey are related, but not the same. This recalibrating of logits is basically what you would do afterwards, to correct for the fact that you have been importance sampling your replay buffer.