3 ms·
Do they do it TO prevent it, or does it provide some additional benefit?
by rjbwork 10y ago
Do they do it TO prevent it, or does it provide some additional benefit?
- Houshalter 10y agoWell sort of both. Because of the reasons mentioned above, a purely linear neural net wouldn't be able to learn anything more complicated than simple linear functions. Adding nonlinearities vastly increases the space of possible functions it can learn.
- rjbwork 10y agoAh right. Makes perfect sense. Cheers!