4 ms·
hm, residual is what I would not expect, can you elaborate why?
by cztomsik 1y ago
hm, residual is what I would not expect, can you elaborate why?
- simsla 1y agoAvoids vanishing gradients in deeper networks. Also, most blocks with a residual approximate the identity function when initialised, so tend to be well behaved.