>It's not been popular lately, but I get the feeling it will come back the more we bump up against the hard limits of tabula rasa-style learning. Most of Neura

>It's not been popular lately, but I get the feeling it will come back the more we bump up against the hard limits of tabula rasa-style learning. Most of Neural Networks ideas exist since the 60s/70s, right now we're just converging to a point where tabula-rasa style learning of smaller neural networks has become feasible with our computing power. It's not that we've made such huge strides in theory, it's more that we can now engineer systems that actually do something useful with NNs. For generalized AI and metaphor based learning, we'll need much much more powerful computers that can stitch together multiple prelearned NNs and modify tweak them just slightly on new data and construct connected multi-domain NNs. This will have the complexity resembling some higher animal brains. Metaphors is kind of another name for using a similar pre built NN as a start for another Neural Network and connecting these in a supernetwork.