In principle. In practice, the "ReLU Algebra" is almost a linear algebra. NN solutions end up being discontinuous stacks of linear regressions. So it's not a

In principle. In practice, the "ReLU Algebra" is almost a linear algebra. NN solutions end up being discontinuous stacks of linear regressions. So it's not a bad place to start in explaining NNs. ReLU NN models are piece-wise linear.