There’s no such thing as real language. Language is loseless compression of perception to allow collaboration of agents. NNs also do loseless compression (from

There’s no such thing as real language. Language is loseless compression of perception to allow collaboration of agents. NNs also do loseless compression (from already compressed data - words). I think with more raw “senses” their compression will get better. Only missing thing is some memory trick. I would even bet that most humans use heuristic thinking and “logic” is just a way of validating legitimacy of these heuristic proposed patters. Once someone replicates this in AI it will get scary. Already things like “Let’s think step by step” are going in this direction. Hierarchical generation of actions might also help (and model understanding that these actions could be used to cause effects). I agree NNs aren’t enough for RL agents but it’s great bootstrap for world model component of agents that probably somewhere between cat-humanity level