3 ms·
Yes - see e.g. "On the importance of initialization and momentum in deep learning" from ICML 2013 (http://www.cs.toronto.edu/~fritz/absps/momentum.pdf http://w
by ajtulloch 12y ago
Yes - see e.g. "On the importance of initialization and momentum in deep learning" from ICML 2013 (http://www.cs.toronto.edu/~fritz/absps/momentum.pdf http://www.cs.toronto.edu/~fritz/absps/momentum.pdf) for an overview in the context of NNs.