He means that neural networks are applied statistics in that they solve a statistical regression problem. It's not conceptually different from classical methods

He means that neural networks are applied statistics in that they solve a statistical regression problem. It's not conceptually different from classical methods of regression like least squares. The phrase "statistically optimized" is certainly a funky one, but regression is certainly as much a part of statistics as the two problems you mentioned.