4 ms·
GPT-3 is about a thousand times less complex than a human How did you figure that? How many synapses are dedicated to text processing in a human brain? How muc
by p1esk 3y ago
GPT-3 is about a thousand times less complex than a human
How did you figure that? How many synapses are dedicated to text processing in a human brain? How much information do those synapses encode compared to the information encoded in GPT-3? How about GPT-4?
- Filligree 3y agoI don't think GP was restricting 'human' to 'text processing elements of a human'. At any rate, it's certainly true that GPT-3 is missing a great deal. So is GPT-4.
- ben_w 3y agoCorrect; mine was an overall statement rather than purely about human language processing.
- __loam 3y agoEstimates for how much information the brain encodes are several orders of magnitude higher than the biggest llm, to the point where trying to replicate it is pushing the boundaries of computability. The brain is also significantly more adaptable and generalized thanks to neuroplasticity.