4 ms·
It's not about the size of the models, it's about the size of the training data. Humans are able to begin to generalize with a single persons experiences over
by Xelynega 3y ago
It's not about the size of the models, it's about the size of the training data.
Humans are able to begin to generalize with a single persons experiences over less than a year, so the fact that LLMs cannot with billions of person-years of information could be an indicator of their inability to generalize no matter how much training data you throw at it.