3 ms·

Luckily we have Shampoo, SOAP, Modula, Schedule-free variants, and many more these days being researched! I am very very excited by the heavyball library in par

by pizza 2y ago

Luckily we have Shampoo, SOAP, Modula, Schedule-free variants, and many more these days being researched! I am very very excited by the heavyball library in particular

3abiton 2y ago
Been out of the loop for while, anything exciting?
- pizza 2y ago
  Read the Modular Norms in Deep Learning paper, and follow the author of the heavyball library on twitter with notifications enabled