3 ms·
The abstract says it can represent "all unbounded multivariate functions." But there are uncomputable functions, so there must be some restriction.
by petters 3y ago
The abstract says it can represent "all unbounded multivariate functions." But there are uncomputable functions, so there must be some restriction.
- yorwba 3y agoThe representation for uncomputable functions will be uncomputable, of course. There's only a countable number of computable functions, so most functions are uncomputable, but that usually doesn't stop mathematicians from proving theorems about them.
- magnio 3y agoThe restriction is that it requires an activation function depending on the function it is approximating. Hence, if you want the NN to emulate an uncomputable function, the activation function probably has to be uncomputable as well.
- valyagolev 3y agoI wonder if there's a subsubsubfield of ML research that goes like "let's use halting-evaluator as an activation function for our purely theoretical neural network". or like, "NNs with oracle"...