Or maybe you mean that the probability assignments are not about the output of a particular LLM implementation in the real world but about subword units of text

Or maybe you mean that the probability assignments are not about the output of a particular LLM implementation in the real world but about subword units of text in the wild. In that case how could two different LLMs do different assigments to the same physical world without being wrong? Would they be “objective” but unrelated to the “object”?