The whole deal seems weird to me. Neural networks are just functional approximators, so why isn't a linear regressor of k-th order (e.g. Taylor expansion up to

The whole deal seems weird to me. Neural networks are just functional approximators, so why isn't a linear regressor of k-th order (e.g. Taylor expansion up to k-th order) also considered "ML"? What's the distinction here?