4 ms·

There is evidence that the human brain is also doing "autocomplete" (prediction). The human brain uses predictive mechanisms when processing language, and these

There is evidence that the human brain is also doing "autocomplete" (prediction). The human brain uses predictive mechanisms when processing language, and these mechanisms play an important role in forming thoughts. When we hear or read a word, our brain quickly generates a set of predictions about what word might come next, based on the context of the sentence and our past experiences with language. These predictions are constantly updated as we receive new information, and they help us to process language more efficiently and accurately. In addition, research has shown that the brain engages in similar predictive processes when we are forming thoughts or planning actions. For example, when we plan a complex movement, such as reaching for a cup, our brain generates a set of predictions about the movements required to complete the action. These predictions are constantly updated as we receive feedback from our muscles and our environment, allowing us to make adjustments and achieve our goal. See links below for additional details: https://www.earth.com/news/our-brains-are-constantly-working-to-predict-what-comes-next/ https://www.earth.com/news/our-brains-are-constantly-working... https://www.psycholinguistics.com/gerry_altmann/research/papers/files/Kamide_et_al_03.pdf https://www.psycholinguistics.com/gerry_altmann/research/pap... https://www.tandfonline.com/doi/pdf/10.1080/23273798.2020.1859568 https://www.tandfonline.com/doi/pdf/10.1080/23273798.2020.18... https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2009.01022.x https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2009...

Probiotic6081 3y ago
And curiously, those predictions that are made during language comprehension are made by the language production system itself!
lsy 3y ago
This is of course sometimes true, we take shortcuts to minimize cognitive effort. However, when the situation warrants it we think more carefully about which words to use to achieve goals, or to reach correspondence with the situation at hand. Or we move more precisely and carefully to do something we haven't done before. I've no doubt that an LLM can approximate whatever model of language a person has from their life experience, but I don't think this type of model is capable of active coping, making judgments, or of having accountability to the world it's meant to operate in.
lacrimacida 3y ago
> When we hear or read a word, our brain quickly generates a set of predictions about what word might come next, based on the context of the sentence Yes a big part of it is prediction but the brain also does something else which LLMs by themselves completely eschew. The human brain imagines in pictures, creates and uses abstractions to refine understanding, studies things and produces new knowledge. When human brains study the goal to understand is different than LLMs.
wraptile 3y ago
It's not only language or some tasks - it's literally everything. Predictive Processing Theory proposes that our whole model is predicting future and only then confirming it through our input signals (eyes, ears etc). I highly recommend The Experience Machine by Andy Clark which explains and arguments this theory very convincingly to the point where I firmly believe it to be true.

Probiotic6081 3y ago

And curiously, those predictions that are made during language comprehension are made by the language production system itself!

lsy 3y ago

This is of course sometimes true, we take shortcuts to minimize cognitive effort. However, when the situation warrants it we think more carefully about which words to use to achieve goals, or to reach correspondence with the situation at hand. Or we move more precisely and carefully to do something we haven't done before. I've no doubt that an LLM can approximate whatever model of language a person has from their life experience, but I don't think this type of model is capable of active coping, making judgments, or of having accountability to the world it's meant to operate in.

lacrimacida 3y ago

> When we hear or read a word, our brain quickly generates a set of predictions about what word might come next, based on the context of the sentence Yes a big part of it is prediction but the brain also does something else which LLMs by themselves completely eschew. The human brain imagines in pictures, creates and uses abstractions to refine understanding, studies things and produces new knowledge. When human brains study the goal to understand is different than LLMs.

wraptile 3y ago

It's not only language or some tasks - it's literally everything. Predictive Processing Theory proposes that our whole model is predicting future and only then confirming it through our input signals (eyes, ears etc). I highly recommend The Experience Machine by Andy Clark which explains and arguments this theory very convincingly to the point where I firmly believe it to be true.