3 ms·
If you unroll an RNN (which is what is done) then you have many copies of a single Feed Forward Network. Nothing fancy. The gradient gets accumulated.
by pmalynin 8y ago
If you unroll an RNN (which is what is done) then you have many copies of a single Feed Forward Network. Nothing fancy. The gradient gets accumulated.