4 ms·
I disagree profoundly. There are things the brain does we have not yet been able to reproduce with a neural network, or to the extent we have seemingly with ex
by NoToP 3y ago
I disagree profoundly.
There are things the brain does we have not yet been able to reproduce with a neural network, or to the extent we have seemingly with excessive resources of training and network size. Therefore there is some salient feature of neurology which has been overlooked. I don't think it is necessary to mimic biology down to the exact function of real neurons, but there must in fact be something we are neglecting to mimic.
- ben_w 3y agoPossibly, but it may also be that we're training them wrong. "Book smart, not street smart" (to use a catchphrase) would apply perfectly to GPT models: brain the size of a rodent's, with 50,000 year's experience of reading Reddit, Wikipedia, and StackOverflow, but no "real life" experiences of its own.