2 ms·
backward activations does but typically not backwards weight gradients. Why compute gradients with regards to weights that aren't going to be updated?
by gdiamos 2y ago
backward activations does but typically not backwards weight gradients.
Why compute gradients with regards to weights that aren't going to be updated?