I apparently didn't get the memo and used stochastic gradient descent with momentum outside of deep learning without running into any problems given a sufficien

I apparently didn't get the memo and used stochastic gradient descent with momentum outside of deep learning without running into any problems given a sufficiently low learning rate. I'm not really convinced that their explanation truly captures why this success should be exclusive to deep learning.