Until that happens: > We recently proposed Muon: a new neural net optimizer. Muon has garnered attention for its excellent practical performance: it was used t

Until that happens: > We recently proposed Muon: a new neural net optimizer. Muon has garnered attention for its excellent practical performance: it was used to set NanoGPT speed records leading to interest from the big labs.