3 ms·Lion, a new Optimizer from Google, provides 3-5x speedup compared to AdamW1 points by nico401 4y ago