There are many such ways to approximate somewhat arbitrary functions. Reproducing Kernel Hilbert Spaces for example. The fact that NN can reproduce arbitrary f

There are many such ways to approximate somewhat arbitrary functions. Reproducing Kernel Hilbert Spaces for example. The fact that NN can reproduce arbitrary functions is decidedly not what makes them special...