2 ms·
Sorry, that was hastily written & could have been clearer. It is, of course, very common to perform (eg) convolution with a larger kernel size, or to use a den
by danielheath 4y ago
Sorry, that was hastily written & could have been clearer.
It is, of course, very common to perform (eg) convolution with a larger kernel size, or to use a dense layer.
However, unlike wet-neurons:
* Convolution has the same local shape for each cell.
* Convolution has no self-suppression for recent activation, vs time-dependent, nonlinear response in wet cells.
* Current silicon offers no performance advantage for interconnect to adjacent cells (could be done).
With ~80 billion neurons in a brain, 1000 is not like a dense layer at all.