> Progress on online learning builds on progress on offline learning, because it's the same optimization procedure. I disagree with this assertion, treating on

> Progress on online learning builds on progress on offline learning, because it's the same optimization procedure. I disagree with this assertion, treating online learning like offline learning means you aren't making any progress. The main difference is that online learning lets you interact with the problem and seek more information, offline learning doesn't. Offline learning doesn't help you at all solving that problem.