3 ms·
The universal approximation theorem does not apply once you include any realistic training algorithms / stochastic gradient descent. There isn't a learnability
by forgot-im-old 2y ago
The universal approximation theorem does not apply once you include any realistic training algorithms / stochastic gradient descent. There isn't a learnability guarantee.
- red75prime 2y agoThere's no theorem that SGD is insufficient. So, as I said, it's empirical.
- forgot-im-old 2y agoYou said it only depends on network size, I'm saying it more likely is impossible regardless of network size due to fundamental limits in training methods.