“The ideal timeframe to use for the reward function” One can punt on this. One can live for today under the constraint of no heroin, etc. Actually I think de

“The ideal timeframe to use for the reward function” One can punt on this. One can live for today under the constraint of no heroin, etc. Actually I think devs have a lot of exp with these types of problems as managing tech debt is a very similar problem---weighing (mutually interactive) actions at different timescales.