4 ms·
Without a non-linear activation function, chaining perceptrons together is equivalent to one large perceptron.
by david2ndaccount 2y ago
Without a non-linear activation function, chaining perceptrons together is equivalent to one large perceptron.
- xanderlewis 2y agoYep. falcor84: you’re thinking of the so-called ‘multilayer perceptron’ which is basically an archaic name for a (densely connected?) neural network. I was referring to traditional perceptrons.
- falcor84 2y agoWhile ReLU is relatively new, AI researchers have been aware of the need for nonlinear activation functions and building multilayer perceptrons with them since the late 1960s, so I had assumed that's what you meant.
- xanderlewis 2y agoIt was a deliberately historical example.