4 ms·
>they can't grasp the cases "Foo is Bar's mother" strictly implies "Bar is Foo's son"? Correction. The Model can. Training cannot.
by famouswaffles 3y ago
>they can't grasp the cases "Foo is Bar's mother" strictly implies "Bar is Foo's son"?
Correction. The Model can. Training cannot.
- TeMPOraL 3y agoI'm starting to wonder, why should it in the first place? Very late stages, or fine-tuning, I'd perhaps understand. But early on? Everything is possible, and "Foo is Bar's mother" doesn't imply much over "these tokens come together, sometimes". It's not that humans aren't suffering from this too. It's possible to spot it when you're learning, or even easier, when you're teaching someone a new thing. A person who learned that "A is B" does not automatically learn that "B is A"; they need to first process it, perhaps run the reversion explicitly in their head. I'd say that checking if the student can infer "B is A" having learned "A is B" is a good way to tell whether they're starting to comprehend the material, vs. just memorizing it.