> Following an old gradient and only updating when it becomes clearly obsolete This sounds exactly like a linesearch https://en.m.wikipedia.org/wiki/Line_searc

> Following an old gradient and only updating when it becomes clearly obsolete This sounds exactly like a linesearch https://en.m.wikipedia.org/wiki/Line_search https://en.m.wikipedia.org/wiki/Line_search