3 ms·
> > Chomsky said that LLMs are statistical regurgitators which means LLMs can never actually reason Othello-GPT managed to develop an internal model of the boa
by Izkata 4y ago
> > Chomsky said that LLMs are statistical regurgitators which means LLMs can never actually reason
Othello-GPT managed to develop an internal model of the board that actually works, it doesn't just regurgitate. Hence, wrong.
- calf 4y agoIMO This an incorrect and unrigorous understanding of what "internal model" means which is why there is a valid scientific debate about this issue.
- mtlmtlmtlmtl 4y agoRegurgitators can't have internal representations? Sometimes the best way to regurgitate is to learn an internal representation. That doesn't mean it suddenly stopped being a statistical model.