> LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition. I don't think th

> LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition. I don't think this is true. They have to express themselves as tokens. The meaning of those tokens doesn't have to be text. See any model that can handle images/video. Also, I don't think math, svg, etc, are "natural" language. And, only the final expression is tokens. The intermediate layers, with the encoded concepts, aren't "natural language". But, to address your concern (which nobody can disagree with, since even humans can't fully express through text/pictures), potentially: https://news.ycombinator.com/item?id=49758615 https://news.ycombinator.com/item?id=49758615