I see a lot of comments along the lines of "it's just predicting the next word". But there's evidence that's what humans do as well: "In the last few decades,

I see a lot of comments along the lines of "it's just predicting the next word". But there's evidence that's what humans do as well: "In the last few decades, there has been an increased interest in the role of prediction in language comprehension. The idea that people predict (i.e., context-based pre-activation of upcoming linguistic input) was deemed controversial at first. However, present-day theories of language comprehension have embraced linguistic prediction as the main reason why language processing tends to be so effortless, accurate, and efficient." https://www.psycholinguistics.com/gerry_altmann/research/papers/files/Kamide_et_al_03.pdf https://www.psycholinguistics.com/gerry_altmann/research/pap... https://www.tandfonline.com/doi/pdf/10.1080/23273798.2020.1859568 https://www.tandfonline.com/doi/pdf/10.1080/23273798.2020.18... https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2009.01022.x https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2009...