10 ms·
I've read this notion before, but whenever I've actually looked into it, neural networks can only seem to represent differentiable/integrale functions, not any
by tsimionescu 5y ago
I've read this notion before, but whenever I've actually looked into it, neural networks can only seem to represent differentiable/integrale functions, not any computable function.
More importantly, the fact that any function can be represented as a NN does NOT mean that any function can be learned through known NN training mechanisms, not even in principle (i.e. given finitely arbitrarily many examples and unbounded but finite time).
And of course, there is always still the vague possibility (which I don't personally subscribe to) that the actual function is not Turing computable, which would mean it certainly can't be approximated by an NN.