If training is indeed done on frame + input, any information that isn't in either of those data sources is simply not there. To achieve object permanence, ther

If training is indeed done on frame + input, any information that isn't in either of those data sources is simply not there. To achieve object permanence, there needs to be some persistent off-screen data from frame to frame. There's a way to achieve this: train on frame+input+woldstate -> frame+woldstate