3 ms·
It seems they're not actually increasing the minibatch size here. I don't see how the updates for N microbatches of size M will be any more out of sync than a s
by aoeusnth1 8y ago
It seems they're not actually increasing the minibatch size here. I don't see how the updates for N microbatches of size M will be any more out of sync than a single large minibatch of size N*M.