4 ms·
You are confusing memory with logical inference. "A is the mother of B" is basically the same logical concept as "B is the child of A", you wouldn't know one an
by foobarqux 3y ago
You are confusing memory with logical inference. "A is the mother of B" is basically the same logical concept as "B is the child of A", you wouldn't know one and not the other. Because LLMs are basically next-word-prediction systems they need to be trained on both pieces of text. In fact you could train them on logically inconsistent text like "A is the mother of B" and "B is not the child of A" and they would happily spit out nonsense.
- Jensson 3y ago> In fact you could train them on logically inconsistent text like "A is the mother of B" and "B is not the child of A" and they would happily spit out nonsense. That is where LLMs are today, and why we can't solve the hallucination problem.