4 ms·
Incidentally, I liked Barto and Sutton's book, but it feels a bit dated. Does anyone have another reinforcement learning book to recommend?
by ced 12y ago
Incidentally, I liked Barto and Sutton's book, but it feels a bit dated. Does anyone have another reinforcement learning book to recommend?
- camlinke 12y agoI chatted with Rich Sutton recently and he said he was writing and update - not sure how far along in the process he is though. Also Csaba Szepesvári (a colleague of Rich's at the U of A) has a free RL book you can download. http://www.ualberta.ca/~szepesva/RLBook.html http://www.ualberta.ca/~szepesva/RLBook.html
- noelwelsh 12y agoCsaba's book is the most up-to-date on RL I know of. Sutton and Barto is very old by now. For the POMDP side of things there are no recent books I know of, but http://www.cs.mcgill.ca/~jpineau/files/sross-jair08.pdf http://www.cs.mcgill.ca/~jpineau/files/sross-jair08.pdf is a recent enough survey. A related book is "Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems" which you can find at http://www.princeton.edu/~sbubeck/index.html http://www.princeton.edu/~sbubeck/index.html The bandit problem is very strongly related to the reinforcement learning problem, so you'll get some mileage out of studying bandits. Be aware this area is very maths heavy, which is good or bad depending on your background. If you like you like this stuff, also checkout "Prediction, Learning, and Games" which deals more with the "adversarial" setup.
- rfrey 12y agoAgree with others that Barto & Sutton is dated, but it's not obsolete. I was chatting a couple weeks ago with one of Sutton's former students, who has since Made Good in both academia and industry working on AI, and he said that the B&S book is all you need to be able to read the literature, so it's still a good place to start. Apparently Sutton was going to do a second book, but has since retreated to a second edition. I'll take it though. :) The Barto and Sutton book is available online too, http://webdocs.cs.ualberta.ca/~sutton/book/the-book.html http://webdocs.cs.ualberta.ca/~sutton/book/the-book.html although the printed copy is a high-quality publication so maybe worth it.
- achompas 12y agoAgreed, it's also a bit topical. Check out Wiering + van Otterlo's "Reinforcement Learning: State-of-the-art." Covers many new techniques--I used it as a reference for a project earlier this year: http://www.springer.com/engineering/computational+intelligence+and+complexity/book/978-3-642-27644-6 http://www.springer.com/engineering/computational+intelligen...