5 ms·in practice, learning_rate * grad(L) is mostly about the direction anyway.by mjburgess 3y agoin practice, learning_rate * grad(L) is mostly about the direction anyway.niederman 3y agoBut the direction is not at all binary, it's a direction in a very high-dimensional weight space.bjourne 3y agoBut the vectors discussed can represent 2^3072 directions. It's close enough.