3 ms·
Newton's method requires calculating the second derivative, which is quite a bit more expensive than SGD, especially with many parameters.
by knicholes 8y ago
Newton's method requires calculating the second derivative, which is quite a bit more expensive than SGD, especially with many parameters.