3 ms·
It only works because of non-linearities. So that seems like too much of a simplification, limiting it to "linear algebra" when it involves both vector calculus
by SomeHacker44 6y ago
It only works because of non-linearities. So that seems like too much of a simplification, limiting it to "linear algebra" when it involves both vector calculus and non-linear algebras.
- mjburgess 6y agoIn principle. In practice, the "ReLU Algebra" is almost a linear algebra. NN solutions end up being discontinuous stacks of linear regressions. So it's not a bad place to start in explaining NNs. ReLU NN models are piece-wise linear.