> This is the tell that present-generation LLM "AI" is not actually intelligent. It doesn't truly understand anything. It's just a general purpose lossy compres

> This is the tell that present-generation LLM "AI" is not actually intelligent. It doesn't truly understand anything. It's just a general purpose lossy compression algorithm for text that is queryable through replaying the model to complete prompts. This is not an argument for it not being intelligent nor is it a coincidence. It has been shown mathematically that there is a deep, fundamental connection between compression and intelligence (an intelligent agent that behaves optimally effectively ends up computing the Kolmogorov complexity of the program that best fits and predicts the environment i.e. optimal compression). I do not know what you mean by "truly understand" since it obviously has an understanding of the various words it uses even if it's knowledge of the "meaning" of a word is simply a vector in a very high-dimensional space. I suppose you think this representation of meaning is profoundly different from meaning as it is represented in the human brain, that the former is a mere facsimile of the meaning while the latter must be the meaning itself, assuming such a thing exists. Even among humans I have conversations with people who use words or phrases for which they clearly have a poor sense of the meaning and make contradictory or nonsensical statements as a result. All this "tells" is that it cannot (effectively?) bootstrap itself to higher performance levels with it's own output. This is not that surprising since humans have the same problem (for similar fundamental reasons). You do not teach children to write better by making them read their own literary output.