3 ms·
What if you're not approximating a continuous function?
by TheOtherHobbes 11y ago
What if you're not approximating a continuous function?
- leni536 11y agoI think it's mostly accurate in L2 norm and not point by point. So every function in L2 can be approximated arbitrarily in L2 norm.
- chestervonwinch 11y agoThis is not true. The theorem proves point-wise convergence for a continuous functions on a compact subset of R^n. See theorem 2, page 6: http://deeplearning.cs.cmu.edu/pdfs/Cybenko.pdf http://deeplearning.cs.cmu.edu/pdfs/Cybenko.pdf
- chestervonwinch 11y agoWell, compact continuous functions are dense in L1, so if you're discontinuous but at least integrable, you probably will still get a nice approximation. Take a box function for instance. Strictly speaking this is not continuous, but it's easy to see it can be approximated arbitrarily well by a couple of sigmoids.