4 ms·
Kingma is most notable for writing one of the most cited papers in AI. Actually one of the most cited scientific papers ever published, right up there with the
by modeless 2y ago
Kingma is most notable for writing one of the most cited papers in AI. Actually one of the most cited scientific papers ever published, right up there with the transformers paper if not higher. "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1412.6980
I remain astonished that Adam continues to be the most widely used optimizer in AI 10 years later. So many contenders have failed to replace it.
- supafastcoder 2y agoI mean, there’s only so many ways to optimize a black box
- LarsDu88 2y agoThe number of papers that use it exceed the number of papers that cite it probably by 100x!
- OutOfHere 2y ago(delete)
- esafak 2y agoThat's an architecture, not an optimizer. You can probably use ADAM with KANs. I think you latched on to the transformers in the sentence, but Kingma did not invent those.
- p1esk 2y agoIn my opinion, he is more notable for inventing a variational autoencoder.