4 ms·
Predicting words != LLM. There's different methods of doing it, current LLMs are not necessarily the most optimal method. The paper states this as well, > This
by thewataccount 4y ago
Predicting words != LLM. There's different methods of doing it, current LLMs are not necessarily the most optimal method. The paper states this as well,
> This computational organization is at odds with current language algorithms, which are mostly trained to make adjacent and word-level predictions (Fig. 1a)
I feel like you're suggesting because humans != LLMs then humans cannot be doing next word prediction.
- thomastjeffery 4y agoLLMs generate continuations. Those continuations are built from the text they are trained on. I see GP suggesting that because humans!= LLMs that "doing word prediction" is not an exhaustive list of human behavior.