g4omingron

6 ms·

1. 1.▲
   Ghosts of Softmax: Zeros of the partition function explain training instability(github.com)

   4 points by g4omingron 7mo ago|3 comments
2. 2.▲
   by g4omingron 7mo ago

   Author here. The short version: softmax's partition function has complex zeros — from e^{iπ}+1=0 — that are invisible on the real line but cap safe step sizes at ρₐ = π/Δₐ. One JVP to compute. The repo has Colab notebooks if you w
3. 3.▲
   by g4omingron 1y ago

   The article is so banal
4. 4.▲
   by g4omingron 7y ago

   So your "true core count" for the entire Summit supercomputer will be one if you run Dijkstra's SSSP on it? What is the bullshit factor for your "true core count"?
5. 5.▲
   by g4omingron 7y ago

   >There's no reason to visit a doctor for the common cold. That's such an american thing to say. A flu can be swine flu and fever can be Malaria or Dangue and one day delay can mean losing your life, so people in many parts of t
6. 6.▲
   by g4omingron 8y ago

   No mention of the most famous Russian book among Indian high Schoolers: [Problems in General Physics by I E Irodov]( https://www.amazon.com/Problems-General-Physics-I-Irodov/dp/... )?
7. 7.▲
   by g4omingron 9y ago

   Yes, it is very normal in an unstructured life, many very smart graduate students at the top universities struggle with it. It is the curse of freedom. People don't realize a regular 9-5 job gives them routine, social commitments and
8. 8.▲
   by g4omingron 9y ago

   yes