3 ms·
In my mind, the layers make the network "non-trivial". A Fourier transform is only a neural network in a trivial, definitional sense.
by nerdponx 6y ago
In my mind, the layers make the network "non-trivial". A Fourier transform is only a neural network in a trivial, definitional sense.
- hyperman1 6y agoThe activation function is what keeps layers separated. When it isn't there, a pair of layers devolves to a matrix multiplication, which can be replaced by its resulting matrix, a single layer.
- omarhaneef 6y agoThat is a thoughtful distinction, too. I think you're right.