Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
g4omingron
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
Ghosts of Softmax: Zeros of the partition function explain training instability
(github.com)
4 points
by
g4omingron
7mo ago
|
3 comments
2.
▲
by
g4omingron
7mo ago
Author here. The short version: softmax's partition function has complex zeros — from e^{iπ}+1=0 — that are invisible on the real line but cap safe step sizes at ρₐ = π/Δₐ. One JVP to compute. The repo has Colab notebooks if you w
3.
▲
by
g4omingron
1y ago
The article is so banal
4.
▲
by
g4omingron
7y ago
So your "true core count" for the entire Summit supercomputer will be one if you run Dijkstra's SSSP on it? What is the bullshit factor for your "true core count"?
5.
▲
by
g4omingron
7y ago
>There's no reason to visit a doctor for the common cold. That's such an american thing to say. A flu can be swine flu and fever can be Malaria or Dangue and one day delay can mean losing your life, so people in many parts of t
6.
▲
by
g4omingron
8y ago
No mention of the most famous Russian book among Indian high Schoolers: [Problems in General Physics by I E Irodov]( https://www.amazon.com/Problems-General-Physics-I-Irodov/dp/... )?
7.
▲
by
g4omingron
9y ago
Yes, it is very normal in an unstructured life, many very smart graduate students at the top universities struggle with it. It is the curse of freedom. People don't realize a regular 9-5 job gives them routine, social commitments and
8.
▲
by
g4omingron
9y ago
yes