4 ms·
One random note I heard on a podcast about child development is that children do not improve their language skills by watching tv or educational material and th
by Eridrus 6y ago
One random note I heard on a podcast about child development is that children do not improve their language skills by watching tv or educational material and that they need feedback to learn.
Contrast that with language models which do nothing besides watching what people are writing, it potentially points to a reason who the amount of data is not comparable.
- rvense 6y agoEven more crucial is that children learn language in situations of actual language use. The things and situations that are spoken about are often at hand in some way, and there is a large social element. No matter how close you might get to "the language learning algorithm", if all you're feeding it is text, it's not going to learn the same thing that kids learn. The data is simply not there.