3 ms·
Ilya Sutskever talk on Sequence to sequence learning with neural networks
- aprilthird2021 2y agoThis recap misses one major point from the talk. He mentions that biologically all mammals follow a scaling law of body size to brain size. The glaring exception is hominids, the ancestors of and present day humans. So there is a way that's different than everything else. Meaning, just because the scaling law of data to AI quality is what we see right now, it doesn't mean a new fundamental paradigm or architecture can't come around and change that scaling law significantly on us. There's precedent for that.
- deleted 2y ago[deleted]