3 ms·
I think humans are obviously different. If a child is told at some point that "The first president of the US was George Washington" then later when they are as
by sebzim4500 3y ago
I think humans are obviously different.
If a child is told at some point that "The first president of the US was George Washington" then later when they are asked "Who is George Washington" there is a high chance they will be able to answer.
LLMs do not seem to have this ability.
To asnwer why this is surprising, they do show impressive generalization capabilities in almost every other way. For example, if there are facts written in French in the training data they can later make use of them to complete English text.
- Grimblewald 3y agoYou must not hang around kids a whole lot. If they aren't directly interested in the I formation they need to hear it many times before they passively acquire it. In that way Llms are the same. If Llms have 'interests' for which they'll acquire information far more readily? I don't know and I don't think anyone else does either but it wouldn't surprisee if it was demonstrable (but not really showing this phenomena) since adding information that is a part of a well spanned domain would be easier than adding information for a novel domain.