Actually, I was expressing faith that shaking molecules in a jar is the path to creating general intelligence. Training over text might work too, I don't know;

Actually, I was expressing faith that shaking molecules in a jar is the path to creating general intelligence. Training over text might work too, I don't know; what I can say is that the more AI tempts investors with the prize of replacing all human mental labour, and the more billions of dollars and brilliant researchers are thrown at picking that prize, the more likely it is that someone will eventually crack the challenge. The apparent effectiveness of transformer-based LLMs is merely weak evidence that, whatever the eventual solution does end up being, it might only require a relatively small number of core insights that work unexpectedly well when applied at large scale. What I don't have is blind confidence that it's an impossible problem that nobody will figure out no matter how hard they try. (Whereas I do have that confidence with respect to perpetual motion remaining unsolved).