3 ms·
But knowledge can be synthesized from information between the cracks of the training data. If one document says word A relates to B and one says word B relates
by basch 4y ago
But knowledge can be synthesized from information between the cracks of the training data.
If one document says word A relates to B and one says word B relates to C, the model has an association between A and C even if no human has ever noticed it before.
At their heart, models are word relationship strength distance and frequency charts. They encode both the semantic meanings of words and the grammar and structure of language. When they take apart a sentence they understand it, if understanding is knowing how closely an idea is to other ideas.
Think about how your own brain works when you hear a phrase, and suddenly it causes you to quite a tv show.