2 ms·
That theoretical child isn't just reading words though. it's experiencing life in a human body, with a human brain, and getting full force of all their senses a
by fragmede 3y ago
That theoretical child isn't just reading words though. it's experiencing life in a human body, with a human brain, and getting full force of all their senses and biology of being human. We don't have a good measure for how much data that is, even if the majority of that is being thrown away. This theoretical child reading from 2-10 is reading fewer words,
sure, but are they being exposed to far less data? The fonts being used, the smell of the books, how the spine cracks. LLMs don't get that in their datasets, just tokens, which isn't even the letters that make up a word.