3 ms·
Can't you run gradient descent on a higher level of abstraction and escape the local minima? People routinely get stuck thinking in a certain way, even when an
by dingo_bat 8y ago
Can't you run gradient descent on a higher level of abstraction and escape the local minima? People routinely get stuck thinking in a certain way, even when an observer looking at the problem from afar can tell that they are stuck.
- api 8y agoYou can if you know what the higher level abstraction is. That kind of thing doesn't work when your learning algorithm doesn't have a programmer / mathematician to babysit it who knows more than it does. ... unless God is sitting there hacking our brains' code in real time to kick us out of local maxima. "Damn it... they're stuck on the mind/body dichotomy again... let me see what happens if I bolt a dimension reduction transform on there and then run another gradient descent on top. Shit now they're worshipping cheese... undo, undo, undo..."