I'm not disagreeing, but this answer is ironic considering how Ilya Sutskever once used detective work as a way to describe the relationship between LLMs and "u

I'm not disagreeing, but this answer is ironic considering how Ilya Sutskever once used detective work as a way to describe the relationship between LLMs and "understanding": "So, I’d like to take a small detour and to give an analogy that will hopefully clarify why more accurate prediction of the next word leads to more understanding, real understanding. Let’s consider an example. Say you read a detective novel. It’s like complicated plot, a storyline, different characters, lots of events, mysteries like clues, it’s unclear. Then, let’s say that at the last page of the book, the detective has gathered all the clues, gathered all the people and saying, “okay, I’m going to reveal the identity of whoever committed the crime and that person’s name is”. Predict that word. Predict that word, exactly. My goodness. Right? Yeah, right. Now, there are many different words. But predicting those words better and better and better, the understanding of the text keeps on increasing. GPT-4 predicts the next word better."