3 ms·
> So then how do humans generalize so well from so little language data? Is “pre-training” on visual data the secret to our success? Aren't you assuming that h
by leshow 2y ago
> So then how do humans generalize so well from so little language data? Is “pre-training” on visual data the secret to our success?
Aren't you assuming that humans are born with some kind of blank slate of a brain? What if they don't get it from their senses. What if language is an innate human ability that is genetically encoded, it isn't learned so much and uncovered, and grows with us like a heart or a lung does?
- greggyb 2y ago> Aren't you assuming that humans are born with some kind of blank slate of a brain? No; FTA: >> ... humans are born with extremely sophisticated programming, provided by evolution. That programming integrates information from all our ancestors, arguably going back to the origin of life on earth. > What if they don't get it from their senses. That's a core question; FTA: >> Is “pre-training” on visual data the secret to our success? >> No. >> Because… blind people? What are we doing here? >> Deaf people show that (non-verbal) sound isn’t critical either.... >> Or maybe all that other sensory data is irrelevant. I don’t know. But that’s kind of the point—...