3 ms·
And far less data in total. Linguistic data is only a tiny fraction of what we humans are exposed to.
by kbelder 4y ago
And far less data in total. Linguistic data is only a tiny fraction of what we humans are exposed to.
- foldr 4y agoI don't think we have good estimates of the total amount of data that factors into human learning. The total amount of raw sensory data we receive over a lifetime is large, for sure, but only a tiny fraction of that is relevant to learning. Just think about how much bigger ChatGPT's training corpus would be if it consisted of .WAV files of people speaking an equivalent amount of text.