I can second a recommendation of the Elements of Statistical Learning. It's well presented, self contained and features good exercises. It may also be slightly

I can second a recommendation of the Elements of Statistical Learning. It's well presented, self contained and features good exercises. It may also be slightly different in presentation from most books on ML because the authors are all professors of statistics, instead of CS. (But, it is NOT a classical statistics textbook.)