3 ms·
> No group of researchers can train a "document-understanding" model simply because they don't have access to the relevant documents or appropriate training lab
by StandardFuture 6y ago
> No group of researchers can train a "document-understanding" model simply because they don't have access to the relevant documents or appropriate training labels for them
This is because you could rename deep learning as "over-parameterized statistics". And statistics is just about building some model of the data. That is the only thing "training" a model is for: discovering/optimizing a statistical distribution (a distribution is a generalization of a function). This means the entirety of deep learning is simply building highly complicated statistical models of a bunch of data.
It is unlikely that this is equivalent to general intelligence found in biology.
We could probably solve the AI problem if the entirety of all of research was not directed at deep learning. And it would also likely be far more valuable to any organization or individual.
But, that is just the 2 cents of some random HN commenter. So, I will keep dreaming.