3 ms·
A child’s model is also “pre-trained” by billions of years of evolution
by dilyevsky 6y ago
A child’s model is also “pre-trained” by billions of years of evolution
- fjfaase 6y agoI understand that you put pre-trained between quotes, but I find it a little far fetched, because, as far as I understand, there is no evidence that any setting of the synpasis strength of certain neurons is transfered through DNA, it is only the organization of neurons, through layers and folds that is somehow encoded in the DNA. I also think that it is still a mystery why certain brain functions occur in certain areas of the brain.
- rubatuga 6y agoThat's still considered parameters of a generalized neural network.
- earthboundkid 6y agoI think that has to be part of it, somehow, although I’m agnostic about whether it’s really analogous to “pretraining” an ML model. Whatever evolution was doing, it managed to give us neural nets that are mostly ready to go out of the box. Especially non-human animals often have short or no training periods.