I think what this all is showing is that language itself is the key invention at making something reason. The next step is to get it working with math symbols

I think what this all is showing is that language itself is the key invention at making something reason. The next step is to get it working with math symbols (I'd think they'd have already done that). Then it's to combine all the ways we 'cheat' at reasoning (street signs, crochet, secret hand shakes, whatever) and see how multiple methods in combination work together. Then, I'd think, we have these AIs come up with new ways to reason that we don't have yet. Once you get the 'theory' down with a lot of examples, it should be able to hallucinate new ones. Then, well, buckle up I guess