4 ms·
That doesn't really follow from the linked research (which is interesting, though).
by ska 4y ago
That doesn't really follow from the linked research (which is interesting, though).
- Izkata 4y ago> > Chomsky said that LLMs are statistical regurgitators which means LLMs can never actually reason Othello-GPT managed to develop an internal model of the board that actually works, it doesn't just regurgitate. Hence, wrong.
- calf 4y agoIMO This an incorrect and unrigorous understanding of what "internal model" means which is why there is a valid scientific debate about this issue.
- mtlmtlmtlmtl 4y agoRegurgitators can't have internal representations? Sometimes the best way to regurgitate is to learn an internal representation. That doesn't mean it suddenly stopped being a statistical model.