4 ms·
I wonder how they deal with the change of the mapping from states to vectors h from the CNN changing as training advances. I reckon they _don't_ train the CNN,
by rhaps0dy 10y ago
I wonder how they deal with the change of the mapping from states to vectors h from the CNN changing as training advances.
I reckon they _don't_ train the CNN, rather, they use it as pre-trained from DQN or something. In that case, no wonder it learns faster.
- tmesisly 10y agothey do train the CNN from scratch, see section 3.4.