3 ms·
> If we had neurons that were 1,000x faster, could we use fewer of them for the same task? Absolutely. In fact, we do: in batched processing (pervasive in deep
by trott 7y ago
> If we had neurons that were 1,000x faster, could we use fewer of them for the same task?
Absolutely. In fact, we do: in batched processing (pervasive in deep learning today), CNNs and other weight sharing schemes (e.g. transformers) the same "neurons" get re-used many times.
- mkl 7y agoThose aren't neurons, though. Biology is different, synaptic connections have to physically fit, etc. Individual neurons serve multiple purposes, but I don't think we know if their speed is a limiting factor in that.