5 ms·
> Humans are not exposed to "billions of words". They are exposed to continuous signals, and somehow extract meaningful representations, like "words" and "objec
by com2kid 4y ago
> Humans are not exposed to "billions of words". They are exposed to continuous signals, and somehow extract meaningful representations, like "words" and "objects", out of them.
Plenty of studies showing long term academic achievement differences based on number of unique words babies are exposed to.
And I promise you, having a baby/toddler is really damn close to doing data labeling. Reading picture books, you are basically labeling objects. Walking around the grocery store, you are labeling objects. All the time, again and again, and the same object will get labeled repeatedly, and sometimes it will even be fact checked. A toddler will point to something that they know is an orange, ask "apple?" and you had sure as hell better reply "orange".
- intalentive 4y ago>having a baby/toddler is really damn close to doing data labeling It's analogous, sure, but not really in the same ballpark. There is no AI system today that you can teach by pointing to things and making noises with your mouth. Why not? What's missing? An awful lot.
- ben_w 4y agoIs anything missing? We've got gesture recognition, so we can do pointing; and that part of the system taken in isolation is not made any harder when the label for an image happens to be from, say, a latent space vector from the interior of an unrelated GAN whose sole purpose is to turn audio input into the specific set of muscle outputs which cause the vocal tract to produce output that sounds the same as a recently heard noise.