2 ms·
Is this reporting on the Newton approximation method or on an update to the Newton method?
by DrNosferatu 2y ago
Is this reporting on the Newton approximation method or on an update to the Newton method?
- magicalhippo 2y agoThe paper is about Newton's method in optimization.
- DrNosferatu 2y agoBut is it genuinely new? Or is it like the unaware rediscovery of Simpson’s Rule: https://diabetesjournals.org/care/article/17/2/152/17985/A-Mathematical-Model-for-the-Determination-of https://diabetesjournals.org/care/article/17/2/152/17985/A-M... ?
- magicalhippo 2y agoI'm not an expert in the field but the Related Work section in the paper has quite a lot of references and seem to cover significant ground. Some quotes from that section: Recently, there has been a body of work following this structure with Taylor expansions of order higher than two [40, 9, 12, 28, 29, 25]. Unlike our paper, these works are in the setting of convex optimization, do not study the complexity of minimizing the regularized Taylor expansion in each iteration [...] To the best of our knowledge, no efficient algorithm for higher-order Newton methods of degree d > 3 has been presented. In fact, designing such an algorithm is referred to as an open problem in [23, Sec. 1.5] and [25, Sec. 5]. To our knowledge, the only works that establish superlinear rates of local convergence for higher-order Newton methods are [47] and [24] (and the related PhD thesis [23]), the latter of which came to our attention at the time of writing this paper. Seems highly unlikely it's anything close to the example you posted.
- DrNosferatu 2y agoThanks for the insight.