4 ms·
It heavily depends upon the definition of general intelligence, because we haven't really settled on a definition as of yet. In some circles (of course the one
by chaxor 3y ago
It heavily depends upon the definition of general intelligence, because we haven't really settled on a definition as of yet. In some circles (of course the ones from Microsoft) the list of requirements is very close to being met by some of the more sophisticated multimodal models (GPT-4 et al).
General intelligence is a strange question because it's more about the data/environment than the architecture, (obviously if it were about theoretical capabilities of architecture, AGI was found ages ago).
Much of the LLM capabilities have to do with the generality baked into language. Pairing that with the well known proof that GNNs are dynamic programmers, you can get some very nice properties directly from the setup.