> With the same right you can argue, that NNs are eassentially fourier series, since under very mild conditions they approximate each other as well. Actually t

> With the same right you can argue, that NNs are eassentially fourier series, since under very mild conditions they approximate each other as well. Actually that's very wrong. Some classes of NN (step function, ReLU, etc) do define piecewise polynomial functions, albeit in a contrived way when compared with simply generating a spline. So the functional space is exactly the same.