3 ms·
The training set for GPT-3 is about 500e9 tokens; any given synapse in a human in their lifetime is going to fire about 2e9s * (10% * {100Hz to 1000Hz}) = 20e9
by ben_w 4y ago
The training set for GPT-3 is about 500e9 tokens; any given synapse in a human in their lifetime is going to fire about 2e9s * (10% * {100Hz to 1000Hz}) = 20e9 to 200e9 times.
- sillysaurusx 4y agoIt sounds like you agree with them, since there are a lot of synapses.
- ben_w 4y agoAu contraire. While our brains are more complex than the networks, this has never been in dispute. The quantity of experiences needed to train GPT-3, however, is many more than we are capable of experiencing in a lifetime.