_jamesm_

5 ms·

1. 1.▲
   by _jamesm_ 8y ago

   Cool, glad to have helped. It seems I have caused a further minor point of confusion though, so a correction to the correction: The original Nesterov Accelerated Gradient paper is about gradient descent, it's just not about stochast
2. 2.▲
   by _jamesm_ 8y ago

   It's always useful to see different SGD methods written with a consistent nomenclature. A few thoughts: 1. Is the 1999 Qian paper on momentum really the most appropriate one, given the comparison of the publication date to NAG? As a cu
3. 3.▲
   by _jamesm_ 10y ago

   The article mentions that: "There may not be one perplexity value that will capture distances across all clusters—and sadly perplexity is a global parameter. Fixing this problem might be an interesting area for future research." T