3 ms·
> with only a fraction of that information you can train a human to perform better than any GPT model shown thus far. That's not a fair comparison. The human n
by nialv7 6y ago
> with only a fraction of that information you can train a human to perform better than any GPT model shown thus far.
That's not a fair comparison. The human neural network is not trained _from scratch_. There is a very good fundamental structure we inherited through millions of years of evolution.
- bigbubba 6y agoYes, I conceded that we aren't blank slates. I still think we're on the wring track.
- webmaven 6y ago> The human neural network is not trained _from scratch_. There is a very good fundamental structure we inherited through millions of years of evolution. It is worth noting that the training data used for training humans has been undergoing it's own optimization process for a while too (arguably for about 40ky, since the Upper Paleolithic Revolution, which is roughly when cultural evolution started taking over). In AI adjusting the training data is called Curriculum Learning. Right now most curriculum learning is done just by adjusting the order of training samples, rather than creating samples specifically optimized to facilitate learning (although GANs might be considered a Socratic approach to the latter, if you squint at it).
- jononor 6y agoAlso, humans created all the text and the language and structures used within, for the purpose of communicating - so it is likely to be a good match for our cognitive systems.