2 ms·
> What I mean can somebody sit down and for a given DNN architecture, write down (at least approximately) the set of functions that it can learn? For a two-lay
by yorwba 10y ago
> What I mean can somebody sit down and for a given DNN architecture, write down (at least approximately) the set of functions that it can learn?
For a two-layer architecture with ReLU activations and n units in the hidden layer, this is the set of piecewise linear continuous functions with n kinks.
- Klockan 10y agoHow many of those do you need to tell the difference between cats and dogs in random internet pictures?