> Another way to look at this problem is by data size. Let's assume we are training a NN using a data set of 10,000 pages text. The total number of pages of all

> Another way to look at this problem is by data size. Let's assume we are training a NN using a data set of 10,000 pages text. The total number of pages of all possible knowledge in the world (ever) is an incalculable number, but let's assume it is a sextillion: 1,000,000,000,000,000,000,000. Then the question is, how much of the sextillion pages of data can be handled by training a NN using 10,000 pages? The answer would obviously be too small compared to the whole. > On the other hand, grammar rules and ontological semantics mastered by the human brain can handle the entire sextillion (since those pages were written by human). If you know how to read and write, the entire sextillion will be understandable to you. This is the horrifying truth between the capabilities of the human brain versus the current state of neural networks. This bit especially doesn't make any sense. I'm a human who has been reading all my life, does that mean I understand every grammar rule or ontological semantic ever created? Of course not! I barely understand all of them in my own language! My 'neural network' (brain) would need a bit more 'training' (studying) before that could happen. Even more, if all I had read in my life were 10,000 pages (which still may be true).