It's right in the most famous system's name: "Generative Pre-trained Transformer". LLMs generate text (and other media) which imitates their pre-training corpus

It's right in the most famous system's name: "Generative Pre-trained Transformer". LLMs generate text (and other media) which imitates their pre-training corpus. That's all. At the end of the day, it's turning a mathematical crank. LLMs have no more intentionality than a jack-in-the-box.