3 ms·
This only means that there is so much more space for AI to grow and improve in the future. As far as I know, having a recursion in neural networks poses an ext
by garganzol 3y ago
This only means that there is so much more space for AI to grow and improve in the future.
As far as I know, having a recursion in neural networks poses an extravagant dilemma: from one hand, recursive networks are more capable; from another, they are harder to train and may have issues with stability caused by occasional positive feedback loops.
- gcr 3y agowell, be careful with "more capable" - the universal approximation theorem shows that a NN with one hidden layer is able to represent any function (in the limit of how wide that layer is, at least). So there's nothing fundamental about "more capable" or "less capable." It's only about which representations are easy to train and which aren't.