Interestingly, as I'm sure you're aware, Wittgenstein later moved away from his ideas of language as more direct representations of thought and reality in his P

Interestingly, as I'm sure you're aware, Wittgenstein later moved away from his ideas of language as more direct representations of thought and reality in his Philosophical Investigations, suggesting it matters more how language is used in language games. I agree with you though that the tractatus is a better framework for thinking about LLMs.