These are great topics that are often neglected by machine learning textbooks. Some of the reason has to do with machine learning textbook writers not really do

These are great topics that are often neglected by machine learning textbooks. Some of the reason has to do with machine learning textbook writers not really doing research in Reinforcement Learning or Time Series. For things like Online Learning the author cites a great book but nothing for a more mainstream audience has been written yet. Much of this stuff is being actively worked on though. If I could give one practical tip. Read KDD conference papers. Those are very applied and usually very accessible demonstrations of what techniques are out there, what problems they are typically applied to and importantly how well they worked. Excellent post.