I’m an ML newb but I think this would be true only of a converged model. Your model could always technically diverge in another epoch if learning rate is high e

I’m an ML newb but I think this would be true only of a converged model. Your model could always technically diverge in another epoch if learning rate is high enough and you process a batch of extreme outliers Even then, you may have still converged on a local optimum which was the take away I got from the article