3 ms·
This is the same reason why I am a bit skeptical of LLM superintelligence. LLMs in the end have to operate in natural language concepts and the complexity of na
by TuxMark5 11d ago
This is the same reason why I am a bit skeptical of LLM superintelligence. LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition. I'm sure super advanced AI could use concepts that humans not only have no words for, but might not be able to understand alltogether. As such if my thesis is correct, the only way forward for true superintelligence may be getting rid of natural language COTs.
- nomel 11d ago> LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition. I don't think this is true. They have to express themselves as tokens. The meaning of those tokens doesn't have to be text. See any model that can handle images/video. Also, I don't think math, svg, etc, are "natural" language. And, only the final expression is tokens. The intermediate layers, with the encoded concepts, aren't "natural language". But, to address your concern (which nobody can disagree with, since even humans can't fully express through text/pictures), potentially: https://news.ycombinator.com/item?id=49758615 https://news.ycombinator.com/item?id=49758615