3 ms·
Yeah, but then you run into the problem of computation speed. Any given neuron in the middle of your brain does 1 computation per second absolute maximum, and 1
by candiodari 6y ago
Yeah, but then you run into the problem of computation speed. Any given neuron in the middle of your brain does 1 computation per second absolute maximum, and 1 per 10 seconds is more realistic. More to the outside (the vast majority of your brain) 1 per 100 seconds is a lot. And it slows down when you age.
This means brains must have a bloody good update rule. You just can't update a neural network in 1 billion operations per second, or 4e17 operations until you're 12, about 2 million training steps per neuron, or about half that assuming you sleep. You cannot get to the level of a 12 year old in 4e17 operations, because GPT-3 does more and while it's impressive, it doesn't have anything on a 12 year old.