3 ms·
Yes but isn't the optimal policy novel information?
by csee 5y ago
Yes but isn't the optimal policy novel information?
- taeric 5y agoBut it's it free of bias and a good execution policy in the real world?
- csee 5y agoThat probably depends on how realistic the simulator is. Your trade off is more bias (due to simulation inaccuracy) in exchange for unlimited data (and hence less variance).
- taeric 5y agoAgreed. I could see a good case of training heavily on simulated data, verify/validate on collected data. My question is ultimately how this really helps with making the system ethical. Just moved the bias from collection to simulation. And... I can't see simulation being less impacted with bias.