>it still doesn't have the ability to do real reasoning. It technically does. Humans solve problems in a recursive way, much like the generative transformer ne

>it still doesn't have the ability to do real reasoning. It technically does. Humans solve problems in a recursive way, much like the generative transformer networks generate the next piece of text. The big difference of course is the depth of reasoning. My bet is that the next big effort is going to be reduce the size of the models while retaining performance (perhaps using ML tasked to do so). Then once you have that, from the other side there will be more and more specialized hardware with ASIC to run the transformers. Eventually we will be able to run these things at scale and do on the fly transfer learning, which will be about the same as a human growing reasoning skills as they mature.