> resorts to cheap tricks like regularization, Regularization is not a 'cheap trick'. It is an essential technique for mathematically ill-posed problems, where

> resorts to cheap tricks like regularization, Regularization is not a 'cheap trick'. It is an essential technique for mathematically ill-posed problems, where no unique solution exists. This is extensively studied and well-understood, and is used in many fields outside of machine learning.