4 ms·
- "linear" in "linear algebra" comes from "system of linear equations" - NN can absolutely represent non-linear functions, and they are based on solving system
by fizixer 6y ago
- "linear" in "linear algebra" comes from "system of linear equations"
- NN can absolutely represent non-linear functions, and they are based on solving system of linear equations.
- The non-linear function here has nothing to do with the linearity of the system of linear equations used to construct it.
- The two main sources of non-linearity are, (a) the inputs (e.g., an image, or a series of images varying a non-linear fashion), and (b) the activation functions.