3 ms·Isn't that just like a Taylor series?by madmaxmcfly 3y agoIsn't that just like a Taylor series?charliea0 3y agoYes - or Fourier series or other decomposition into a sum of orthogonal basis functions.mkl 3y agoI don't think orthogonality is important here. Taylor series basis functions are not orthogonal, and nor are ReLUs.