3 ms·
In terms of number of neurons, human brain is around 10^11. Current image classification deep networks are around 10^7. However, its not just the number of neur
by chimtim 10y ago
In terms of number of neurons, human brain is around 10^11. Current image classification deep networks are around 10^7. However, its not just the number of neurons, the connections per neurons also matter. The connections per neuron in a human are in thousands while in modern networks they are in hundreds.
The human brain is also very efficient so it also makes a very good use of those neurons, and modern networks aren't. However, a human brain trains over a very very long time and also prunes itself constantly, while such efficiency techniques at scale for very large networks are being explored in deep learning only recently.