3 ms·
Is this the first time that the gradient clip threshold has been chosen relative to the size of the weight matrix?
by highfrequency 6y ago
Is this the first time that the gradient clip threshold has been chosen relative to the size of the weight matrix?