3 ms·
Ya. And the choice of optimizer (in this case adam) also imposes upon it some regularization scheme. I just thought I'd highlight a bit of funniness.
by chewxy 7y ago
Ya. And the choice of optimizer (in this case adam) also imposes upon it some regularization scheme.
I just thought I'd highlight a bit of funniness.
- profunctor 7y agoHow does Adam provide regularisation? I’d never heard of this before and I don’t recall it from when I read the paper.