Well shit, there goes the originality of my topic idea (probably already wasn’t so much). But anyway, should not be surprising that function approximation can

Well shit, there goes the originality of my topic idea (probably already wasn’t so much). But anyway, should not be surprising that function approximation can be done with polynomials. Regression has big problems though, as the problem size increases, which SGD/backprop seems impervious to. That’s kind of the mystery behind neural nets.