4 ms·

ReLU networks are piecewise linear.

• RandyRanderson 6y ago
  Have a look at some published nn architectures - you'll typically see a few nonlinear units/transforms and a LOT of ReLU ones.