2 ms·

thanks, I will look at Silver’s lectures. I have not finished reading Sutton and Barto’s RL book yet, so I am still a beginner.