4 ms·
> Another facet is that we currently have "1 training regime" for digital neural networks, with which I mean: we use gradient descent Speak for yourself! There
by inimino 7y ago
> Another facet is that we currently have "1 training regime" for digital neural networks, with which I mean: we use gradient descent
Speak for yourself! There are plenty of other ways. Gradient descent is just currently in fashion.
- DoctorOetker 7y agosure there are other means of training, I was highlighting that nearly all approaches use only one improvement approach during training (gradient descent, genetic algorithms, ...) and if multiple are used the whole model is using the same balance of multiple approaches.
- inimino 7y agoAh then agreed. My take is if you have a feedforward network, add time delays, because synapses aren't running in lockstep, and add connections arbitrarily with any two neurones, only limited by the physical distance between them, and then add in every kind of diffuse effect of neurotransmitters and all the brain chemicals we haven't discovered yet, and then figure out how to train it... you still won't have a human brain equivalent, because it is harder than that. But you might get something that can learn! All you need is a dopamine reward button, and some way to whack it with a stick every now and then. I think we're more likely to create AGI than to understand how the brain works in our lifetimes.