This NN breakthrough in language is only about 2 years old now [0]. People are working on your symbolic logic hybrid approach, but not much interesting has hap

This NN breakthrough in language is only about 2 years old now [0]. People are working on your symbolic logic hybrid approach, but not much interesting has happened yet. This is a bit expected, since the short amount of time, and the fast scaling these language models have done in those last two years. It's been hard to outscale them with any other approach, let alone by the particular one of symbolic logic. I think the main discripancy with particle physics, is that every iteration of bigger language models are also significantly better, no diminishing returns in sight. Better for concrete applications as well. There is therefore no need to claim these models are scaled for scientific reasons in the search of AI, the accountants are happy as it is. [0] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165