4 ms·
I’m not able to read billions of books in less than an hour. I think you underestimate the sheer volume of data + conclusions the brain ingests and processes o
by kirse 4y ago
I’m not able to read billions of books in less than an hour.
I think you underestimate the sheer volume of data + conclusions the brain ingests and processes on a daily basis, primarily through unconscious experience.
- ben_w 4y agoThe training set for GPT-3 is about 500e9 tokens; any given synapse in a human in their lifetime is going to fire about 2e9s * (10% * {100Hz to 1000Hz}) = 20e9 to 200e9 times.
- sillysaurusx 4y agoIt sounds like you agree with them, since there are a lot of synapses.
- ben_w 4y agoAu contraire. While our brains are more complex than the networks, this has never been in dispute. The quantity of experiences needed to train GPT-3, however, is many more than we are capable of experiencing in a lifetime.
- kennyloginz 4y agoNot not mention the millions of years building our nervous system.
- jacquesm 4y ago100's of millions of years.
- sinity 4y agoGPT-3 is learning from ridiculously dense data through. Also, about volume of data processed by the brain: https://gwern.net/Differences https://gwern.net/Differences